Skip to main content
TRUST

Research Thrust

Trustworthy Autonomous & Agentic AI

Ensuring AI agents that retrieve knowledge, invoke tools, and act autonomously remain explainable, accountable, and aligned with human intent.

AI systems are increasingly composed of autonomous agents that retrieve external knowledge, call software tools, coordinate with other agents, and take actions with real-world consequences. Trust in these systems requires more than predictive accuracy — it requires explainability, accountability, and verifiable alignment between agent behavior and human intent.

This thrust focuses on:

  • Explainability and interpretability methods for autonomous and agentic AI decision-making
  • Accountability, auditability, and provenance tracking across multi-agent and tool-using pipelines
  • Safety and alignment evaluation for retrieval-augmented and tool-invoking large language model systems
  • Resilience of autonomous agents operating in uncertain, adversarial, or partially observable environments

The aim is to develop principled foundations and practical tools for deploying autonomous AI agents that remain transparent, controllable, and trustworthy as their autonomy increases.

Related Work

Publications in this Area

Workshop Published

Multilingual Code Evaluation with LLM-as-a-Judge: AI-Assisted Feedback for Human-Centric Understanding

Al Amin, et al.

AI-SQE at ICSE, 2026

Trustworthy Autonomous & Agentic AI
Cite this work

Al Amin et al. "Multilingual Code Evaluation with LLM-as-a-Judge: AI-Assisted Feedback for Human-Centric Understanding." AI-SQE at ICSE, 2026.

Journal Published

XAI-Empowered MRI Analysis for Consumer Electronic Health

Al Amin, et al.

IEEE Transactions on Consumer Electronics, 2025 · vol. 71 , no. 1

Trustworthy Autonomous & Agentic AI
Cite this work

Al Amin et al. "XAI-Empowered MRI Analysis for Consumer Electronic Health." IEEE Transactions on Consumer Electronics, vol. 71, no. 1, 2025.

Conference Published

An Explainable AI Framework for Artificial Intelligence of Medical Things

Al Amin, et al.

IEEE GLOBECOM, 2023

Trustworthy Autonomous & Agentic AI
Cite this work

Al Amin et al. "An Explainable AI Framework for Artificial Intelligence of Medical Things." IEEE GLOBECOM, 2023.

← Back to all research areas