Home | LLMSC

The 3^rd International Workshop on Large Language Model Supply Chain Analysis
(LLMSC 2027)

Co-located with ICSE'27
Tuesday, 27 April 2027 · Dublin, Ireland

About

Welcome to the 3rd International Workshop on Large Language Model Supply Chain Analysis (LLMSC)!

Large Language Models (LLMs) are no longer delivered as standalone models. They are increasingly embedded into agentic software systems that combine foundation models, datasets, prompts, tools, plugins, MCP servers, skills, harnesses, and multi-agent workflows. These components are developed, shared, installed, composed, updated, and governed by different stakeholders across open-source, industrial, and platform ecosystems. Together, they form an emerging LLM and agentic supply chain.

Workshop Structure

This shift enables increasingly autonomous agentic systems, but also introduces risks that traditional software supply chain analysis cannot fully capture. The emerging risks in this ecosystem may span heterogeneous artifacts, platforms, and lifecycle stages, making the LLM and agentic supply chain highly complex, dynamic, and difficult to analyze. Addressing these challenges requires new methods, tools, benchmarks, and governance frameworks for understanding and securing agentic software systems.

LLMSC aims to bring together researchers, practitioners, and policymakers from software engineering, security, AI, systems, and policy to discuss the analysis, security, reliability, and governance of the LLM and agentic supply chain. We welcome work on ecosystem measurement, dependency and provenance analysis, model and data governance, agent harness engineering, MCP and skill security, vulnerability detection, malicious component analysis, compliance, risk assessment, and responsible deployment practices, with the broader goal of building a more transparent, trustworthy, resilient, and sustainable agentic supply chain ecosystem.

Status: LLMSC 2027 will be co-located with ICSE 2027 on Tuesday, 27 April 2027 in Dublin, Ireland.

Journal Invitation: Selected outstanding papers from the 3rd workshop will be invited to submit revised and substantially extended versions for consideration by ASE Journal, subject to the journal's standard peer-review process.

📢 Call for Papers

Topics of interest include, but are not limited to:

Ecosystem Modeling and Empirical Analysis
- Modeling, measurement, and evolution analysis of LLM and agentic software ecosystems.
- Dependency, provenance, and reuse analysis across models, datasets, prompts, tools, agents, and applications.
- Empirical studies of model hubs, app stores, registries, repositories, and open-source LLM ecosystems.
Toolchains and Agentic Systems
- Engineering practices for LLM applications, RAG systems, AI coding tools, and agentic workflows.
- Design, testing, and evaluation of web agents, coding agents, workflow agents, and multi-agent systems.
- Integration of LLMs with APIs, plugins, vector databases, memory stores, enterprise systems, and external tools.
Toolchains, Infrastructure, and Operations
- Analysis and benchmarking of LLM frameworks, SDKs, orchestration platforms, and deployment pipelines.
- Testing, monitoring, observability, and reliability assessment of LLM-based and agentic software systems.
- Runtime behavior analysis, action trace auditing, failure diagnosis, scalability, and production readiness.
Security, Privacy, and Governance
- Security and privacy analysis of LLM supply chains, agent frameworks, tools, plugins, protocols, and registries.
- Threat modeling and vulnerability detection for prompt injection, tool poisoning, memory poisoning, unsafe tool use, and data leakage.
- Risk assessment, vulnerability propagation, license compliance, responsible disclosure, standardization, and governance.

Submission Guidelines

We welcome the following two types of submissions:

Position papers (1-4 pages including references): Well-argued position or work in progress.
Research papers (4-8 pages including references): Technical research, experience reports, empirical studies, etc.

Requirements

Originality: All submissions must be original and not under review elsewhere. Workshop organizers and their current directly supervised students may not submit refereed papers to the workshop.
Submission format: Submissions must be written in English and submitted in PDF format. Papers must not exceed the page limits listed above. Papers must follow the official IEEE conference proceedings format. Authors should use the IEEE Conference Proceedings Formatting Guidelines. LaTeX users should use \documentclass[10pt,conference]{IEEEtran}.
Submission site: Papers must be submitted via the submission site.
Publication date: The official publication date of the workshop proceedings is the date the proceedings are made available by IEEE. This date may be up to two weeks prior to the first day of ICSE 2027. The official publication date affects the deadline for any patent filings related to published work.
Registration, presentation, and proceedings eligibility: To be included in the Workshop Proceedings, each accepted paper must be presented at the workshop, and at least one of its authors must register for the workshop. If no author has registered for an accepted paper within two weeks after the Early Registration Deadline, ICSE 2027 reserves the right to remove the paper from the Workshop Proceedings. If no author or designated presenter attends the workshop to present the paper, the paper will be considered a no-show.
Notification: By submitting to LLMSC 2027, authors acknowledge that they conform to the authorship policy of IEEE, the submission policy of IEEE, the authorship policy of ACM, and the ACM Publications Policy on Research Involving Human Participants and Subjects. Other detailed submission policies and formatting guidelines are aligned with the ICSE 2027 Research Track submission process.

Review Process

Submissions will receive at least three reviews under a double-blind process.
Authors must anonymize submissions, supplementary materials, and metadata.
Evaluation criteria include originality, relevance, technical soundness, and clarity of presentation.

Important Dates