LLMSC27

The 3^rd International Workshop on Large Language Model Supply Chain Analysis
(LLMSC 2027)

Tentatively planned with ICSE'27
Dublin, Ireland · Workshop slot to be assigned within April 25-27 or May 1, 2027

About

Welcome to the 3rd International Workshop on Large Language Model Supply Chain Analysis (LLMSC)!

Large Language Models (LLMs) are no longer delivered as standalone models. They are increasingly embedded into agentic software systems that combine foundation models, datasets, prompts, tools, plugins, MCP servers, skills, harnesses, and multi-agent workflows. These components are developed, shared, installed, composed, updated, and governed by different stakeholders across open-source, industrial, and platform ecosystems. Together, they form an emerging LLM and agentic supply chain.

Workshop Structure

This shift enables increasingly autonomous agentic systems, but also introduces risks that traditional software supply chain analysis cannot fully capture. The emerging risks in this ecosystem may span heterogeneous artifacts, platforms, and lifecycle stages, making the LLM and agentic supply chain highly complex, dynamic, and difficult to analyze. Addressing these challenges requires new methods, tools, benchmarks, and governance frameworks for understanding and securing agentic software systems.

LLMSC aims to bring together researchers, practitioners, and policymakers from software engineering, security, AI, systems, and policy to discuss the analysis, security, reliability, and governance of the LLM and agentic supply chain. We welcome work on ecosystem measurement, dependency and provenance analysis, model and data governance, agent harness engineering, MCP and skill security, vulnerability detection, malicious component analysis, compliance, risk assessment, and responsible deployment practices, with the broader goal of building a more transparent, trustworthy, resilient, and sustainable agentic supply chain ecosystem.

Status: This page is currently a planning page. LLMSC 2027 is tentative, and workshop-specific details such as the final date, paper categories, submission site, and deadlines will be announced after the ICSE 2027 workshop process is finalized.

Journal Invitation: Selected outstanding papers from the 3rd workshop will be invited to submit revised and substantially extended versions for consideration by ASE Journal, subject to the journal's standard peer-review process.

📢 Call for Papers

Topics of interest include, but are not limited to:

Ecosystem Modeling and Empirical Analysis
- Modeling, measurement, and evolution analysis of LLM and agentic software ecosystems.
- Dependency, provenance, and reuse analysis across models, datasets, prompts, tools, agents, and applications.
- Empirical studies of model hubs, app stores, registries, repositories, and open-source LLM ecosystems.
Toolchains and Agentic Systems
- Engineering practices for LLM applications, RAG systems, AI coding tools, and agentic workflows.
- Design, testing, and evaluation of web agents, coding agents, workflow agents, and multi-agent systems.
- Integration of LLMs with APIs, plugins, vector databases, memory stores, enterprise systems, and external tools.
Toolchains, Infrastructure, and Operations
- Analysis and benchmarking of LLM frameworks, SDKs, orchestration platforms, and deployment pipelines.
- Testing, monitoring, observability, and reliability assessment of LLM-based and agentic software systems.
- Runtime behavior analysis, action trace auditing, failure diagnosis, scalability, and production readiness.
Security, Privacy, and Governance
- Security and privacy analysis of LLM supply chains, agent frameworks, tools, plugins, protocols, and registries.
- Threat modeling and vulnerability detection for prompt injection, tool poisoning, memory poisoning, unsafe tool use, and data leakage.
- Risk assessment, vulnerability propagation, license compliance, responsible disclosure, standardization, and governance.

Submission Guidelines

We welcome the following two types of submissions:

Position papers (1-4 pages including references): Well-argued position or work in progress.
Research papers (4-8 pages including references): Technical research, experience reports, empirical studies, etc.

Requirements

Originality: All submissions must be original and not under review elsewhere. Workshop organizers and their current directly supervised students may not submit refereed papers to the workshop.
Submission format: Submissions must be written in English and submitted in PDF format. Papers must not exceed the page limits listed above. Papers must follow the official IEEE conference proceedings format. Authors should use the IEEE Conference Proceedings Formatting Guidelines. LaTeX users should use \documentclass[10pt,conference]{IEEEtran}.
Submission site: TBD
Publication date: The official publication date of the workshop proceedings is the date the proceedings are made available by IEEE. This date may be up to two weeks prior to the first day of ICSE 2027. The official publication date affects the deadline for any patent filings related to published work.
Notification: By submitting to LLMSC 2027, authors acknowledge that they conform to the authorship policy of IEEE, the submission policy of IEEE, the authorship policy of ACM, and the ACM Publications Policy on Research Involving Human Participants and Subjects. Other detailed submission policies and formatting guidelines are aligned with the ICSE 2027 Research Track submission process.

Review Process

Submissions will receive at least three reviews under a double-blind process.
Authors must anonymize submissions, supplementary materials, and metadata.
Evaluation criteria include originality, relevance, technical soundness, and clarity of presentation.

Important Dates