SynthIR @ SIGIR 2026

Special Interest Group on Information Retrieval

SIGIR 2026 (https://sigir.org/)

Workshop on

SynthIR: The First Workshop on Synthetic Content in Information Retrieval Ecosystems (SIGIR 2026)

workshop logo

SynthIR focuses on the system-level implications of AI-generated content in retrieval ecosystems, emphasizing evaluation validity, provenance, user trust, and human-centered design in mixed (synthetic + human-authored) information environments.

[Submission Site]

SEED: Benchmark for Provenance Tracing in Sequential Deepfake Facial Edits

competition logo

We introduce SEED, the first large-scale benchmark for sequential visual provenance tracing in facial imagery. SEED contains 91,526 images built from highquality real face datasets (FFHQ and CelebAMask-HQ) and edited by diffusion-based pipelines. Unlike prior benchmarks that focus on isolated manipulations, SEED targets sequential editing: each sample is produced by applying one to four attribute edits in order, where later operations may partially overwrite earlier traces.

[Competition Site]

[Paper Site]

[!NOTE] The submission deadline has been extended to 6 June 2026. We encourage participants to publicly release their code to support reproducibility and community reuse. We will issue certificates for the Best Paper Award, Most Creative Approach Award, and Community Contribution Award.

News

  • 28/2/2026 - Workshop homepage is now available.
  • 10/4/2026 - Competition is now available.
  • 26/5/2026 - Submission deadline has been extended to 6 June 2026.
  • 29/6/2026 - Notification and camera-ready dates have been updated.

Important Dates

Please note: Deadlines are at 11:59 p.m. of the stated deadline date Anywhere on Earth

  • Competition deadline: 21 May 2026
  • Submission deadline: 30 May 2026 6 June 2026
  • Notification: 22 June 2026 29 June 2026
  • Camera-ready: 29 June 2026 4 July 2026

Abstract

The proliferation of AI-generated content is fundamentally altering the information ecosystems in which retrieval systems operate. Search engines, recommender systems, and retrieval-augmented generation pipelines increasingly function in mixed environments where synthetic and human-authored content are tightly interwoven, raising system-level challenges for information retrieval. SynthIR provides a forum to examine these implications with emphasis on reflection, evaluation, and human-centered system design, and to foster community discussion that may inform future evaluation efforts and shared tasks.

Themes and Discussion Tasks

Focus areas include evaluation validity, provenance/attribution, grounding and trust signals, and user interaction in AIGC-aware IR systems.

Micro shared tasks (lightweight analytical exercises):

  • Task A: AIGC in ranked retrieval results — ranking placement, perceived quality, provenance signals, and evaluation gaps.
  • Task B: AIGC in retrieval-augmented generation (RAG) — factual alignment, attribution quality, hallucination patterns, and trust signals.
  • Task C: Model provenance and attribution — provenance availability, attribution granularity, uncertainty representation, and impact on ranking/trust.
  • Case study: sequential AIGC edits and provenance challenges in IR.

Submission Guidelines

[Submission Site]

Full research papers must describe original work that has not been previously published (except on pre-print servers, see below for details), not accepted for publication elsewhere, and not simultaneously submitted or currently under review in another journal or conference (including the other tracks of SIGIR 2026). Please note that concurrent submissions are a violation of the ACM Policy on Authorship. The SIGIR 2026 program chairs will refer any such violations to the Ethics & Plagiarism Committee of the ACM Publications Board.

Submissions of full research papers must be in English, in PDF format, and be at most 4 pages (including figures, tables, proofs, appendixes, acknowledgments, and any content except references) in length, with unrestricted space for references, in the current ACM two-column conference format. Suitable LaTeX, Word, and Overleaf templates are available from the ACM Website (use “sigconf” proceedings template for LaTeX and the Interim Template for Word). ACM’s CCS concepts and keywords are required for review.

For LaTeX, the following should be used:

\documentclass[sigconf,natbib=true,anonymous=true]{acmart}

Workshop Format and Schedule

SynthIR is planned as a highly interactive half-day workshop, structured to move from shared context setting to task-driven analysis and participant-driven discussion.

Date: July 24, 2026

Location: Room 112

Zoom: Join the workshop

Presentation Videos: Google Drive shared folder (Access must be requested before viewing.)

Time Paper PDF
13:30–13:45 Welcome and Award Announcement —
13:45–14:30 Invited Talk
Prof. J. Shane Culpepper, University of Queensland, AU
—
14:30–14:45 Towards Vision-Free CIR: Attribute-Augmented Scoring and LLM-Based Reranking for Zero-Shot Composed Image Retrieval
Ryotaro Shimada, Yu-Chieh Lin, Yuji Nozawa, Youyang Ng, Osamu Torii, and Yusuke Matsui
SIGIR 2026 SynthIR Workshop
In-person presentation
PDF
14:45–15:00 HybridQPP: Scaling Synthetic Evaluation Signals through Pointwise and Pairwise LLM Alignment
Cezary Golecki, Aleksander Wawer, and Paweł Zawistowski
SIGIR 2026 SynthIR Workshop
In-person presentation
PDF
15:00–15:15 Remote Talk: Competition Benchmark
Mr. Mengieong Hoi
—
15:15–15:30 Coffee break —
15:30–15:45 Silent Failures in Multimodal Agentic Search: A Diagnostic Taxonomy and Cross-Judge Evaluation
Zhengxian Wu, Junjie Gao, and Kai Yang
SIGIR 2026 SynthIR Workshop
Video presentation
PDF
15:45–16:00 Faithful or Findable? Evaluating LLM-Generated Metadata for RDF Dataset Search
Riccardo Terrenzi and Serkan Ayvaz
SIGIR 2026 SynthIR Workshop
Video presentation
PDF
16:00–16:15 OpenCoderRank: Personalized Technical Assessments with Generative AI
Hridoy Sankar Dutta, Sana Ansari, Swati Kumari, and Shounak Ravi Bhalerao
SIGIR 2026 SynthIR Workshop
Video presentation
PDF
16:15–16:30 Relevant but Hard to Recover: An Empirical Study of AIGC Rewrites in Ranked Retrieval
Ding Wu
SIGIR 2026 SynthIR Workshop
Video presentation
PDF
16:30–16:45 When Do LLM-Generated Note Cards Help Retrieval and Reranking?
Shanmin Sun and Xinlu Lin
SIGIR 2026 SynthIR Workshop
Video presentation
PDF
16:45–17:00 EMMM, Explain Me My Model! Explainable Multi-Dimension Multi-Level Multi-Strategy Chatbot Detection
Angela Yifei Yuan, Haoyi Li, Soyeon Caren Han, and Christopher Leckie*
SIGIR 2026 SynthIR Workshop
Awaiting confirmation
PDF

Organizing Team

Ping Liu, University of Nevada, USA Zhedong Zheng, University of Macau, China J. Shane Culpepper, University of Queensland, Australia Xin Yu, Adelaide University, Australia

Contact

For questions, please contact the organizers. (Replace this line with your preferred contact email / form.)

Workshop Citation

@inproceedings{SynthIR2026,
  title     = {SynthIR: Workshop on Synthetic Content in Information Retrieval Ecosystems},
  booktitle = {Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026) Workshops},
  author = {Ping Liu, Zhedong Zheng, J. Shane Culpepper, Xin Yu},
  year      = {2026}
}

Competition & Benchmark Citation

@misc{hoi2026seedlargescalebenchmarkprovenance,
      title={SEED: A Large-Scale Benchmark for Provenance Tracing in Sequential Deepfake Facial Edits}, 
      author={Mengieong Hoi and Zhedong Zheng and Ping Liu and Wei Liu},
      year={2026},
      eprint={2604.10522},
      archivePrefix={arXiv},
      primaryClass={cs.CR},
      url={https://arxiv.org/abs/2604.10522}, 
}