FIRE 2023

Forum for Information Retrieval Evaluation

Goa Business School, Goa University, Panjim

15th-18th December

To see Breakfast and lunch arrangement, please click here

All time written are in IST
Day 1 : Friday 15 December
Venue-FF7, First Floor , Goa Business School, Goa University
8:30 - 9:00 Registration
9:00 - 9:15 Opening Remarks
9:15 - 10:00 Keynote address:
  • How (un)important is complex NLP in transformers for text ranking? - Jaap Kamps slides
10:00-11:45 Track overview (~15 minutes each)
Session Chair: Kripabandhu Ghosh
  • Artificial Intelligence on Social Media (AISoMe) - Kripabandhu Ghosh slides
  • Cross-Lingual Information Retrieval for African Languages (CIRAL) - Mofetoluwa Adeyemi slides
  • Tea Break
  • Uncovering Truth in Social Media through Claim Detection and Identification of Claim Spans (CLAIMSCAN) - Megha Sundriyal slides
  • Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages (HASOC) - Thomas Mandal, Koyal Goash, Sarah Masud slides
  • Information Retrieval in Software Engineering (IRSE) - Srijoni Majumdar slides
11:45-12:30 Keynote address:
  • Evaluation Challenges and Current Limits in IR and NLP: Experiences at the CLEF SimpleText and JOKER Tracks: Liana Ermakova slides
12:30-13:15 Lunch Break & Doctoral Consortium Poster Presentations
13:15-14:30 Track overview (~15 minutes each)
Session Chair: Kripabandhu Ghosh
  • Scarcasm Identification of Dravidian Languages (Malayalam and Tamil) in DravidianCodeMix 2023 (DravidianCodeMix) - Kishore Kumar Ponnusamy slides
  • Word-level Language Identification in Code-mixed Tulu Texts (CoLI-Tunglish) - Asha Hegde slides
  • Indian Language Summarization (ILSUM) - Parth Mehta slides
  • Machine Translation for Indian Languages (MTIL) - Surupendu Gangopadhyay slides
14:30-15:00 Conference Track : Resource and Demo Paper (~10 minutes each)
Session Chair: Debasis Ganguly
  • Financial Argument Analysis in Bengali - Rima Roy / Sohom Ghosh slides
  • L3Cube-MahaSocialNER: A Social Media based Marathi Named Entity Recognition Dataset and BERT models - Anuja Patil (Online) slides
  • Helping Hands - An AI based Real Time System for Effective Flood Relief Operations in Indian Cities - Abhay Banerjee (Online)
15:00-15:15 Tea Break
15:15-16:30 Conference Track : Regular Paper (~15 minutes each)
Session Chair: Debasis Ganguly
  • The Mask One At a Time Framework for Detecting the Relationship between Financial Entities - Sachin Umrao / Sohom Ghosh slides
  • Harnessing the Power of Prompt-based Techniques for Generating School-Level Questions using Large Language Models - Subhankar Maity slides
  • CricGPT: A GPT-aided Question-Answering system for Cricket - Kripabandhu Ghosh slides
  • Keyword Driven Language-Independent Low-Resource Graph-Based Automatic Text Summarization of Konkani Texts - Chaitali More slides
  • Are we describing the same sound? An analysis of word embedding spaces of expressive piano performance - Silvan David Peter slides
17:00-18:00 Steering Committee Meeting
19:00 Banquet


Day 2 : Saturday 16 December
Venue-FF7, First Floor, Goa Business School, Goa University
9:00-9:45 Keynote address:
  • Broken Telephone: Evangelos Kanoulas slides
9:45-10:45 Information Retrieval in Software Engineering (IRSE) Presentation (~5 minutes each)
Session Chair: TBD
  • Software Metadata Classification based on Generative Artificial Intelligence- Seetharam Killivalavan slides
  • Source Code Comment Classification using Naive Bayes and Support Vector Machine- Raj Shah slides
  • A ML-LLM pairing for better code comment classification- Hanna Abi Akl (Online) slides
  • Binary Classification of Source Code Comments using Machine Learning Models- Lisa Sarkar slides
  • Source Code Comment Classification using machine learning algorithms- Trisha Datta slides
  • A study of the impact of generative AI-based data augmentation on software metadata classification - Tripti Kumari slides
  • Leveraging Language Models for Code Comment Classification- Jagrat T Patel slides
  • On the Impact of Synthetic Data on Code Comment Usefulness Prediction - Vishesh Agarwal
10:45-11:00 Tea Break
11:00-11:45
    Cross-Lingual Information Retrieval for African Languages (CIRAL) Presentation (~5 minutes each)
    Session Chair: TBD
    • Extending Translate-Train for ColBERT-X to African Language CLIR-Eugene Yang slides
    Uncovering Truth in Social Media through Claim Detection and Identification of Claim Spans (CLAIMSCAN) (~5 minutes each)
    Session Chair: Megha Sundriyal
    • Current language models’ poor performance on pragmatic aspects of natural language - Julia Waldmüller (online) slides
    • Positional Transformers for Claim Span Identification - Michael Sullivan (online) slides
11:45-12:30 Keynote address:
  • Disinformation and relevance in search: Open Issues and Challenges: Gabriella Pasi slides
12:30-13:15 Lunch Break & Doctoral Consortium Poster Presentations
13:15-14:00 Word-level Language Identification in Code-mixed Tulu Texts (CoLI-Tunglish) Presentation (~5 minutes each)
Session Chair: H. L. Shashirekha
  • Word-Level Language Identification of Code-Mixed Tulu-English Data - Poorvi Shetty (Online) slides
  • Word-level Language Identification in Code-mixed Tulu Texts(CoLI-Tunglish) - Asha Hegde slides
  • Advancing Language Identification in Code-Mixed Tulu Texts:Harnessing Deep Learning Techniques -Anshika Mishra slides
  • BFCAI at CoLI-Tunglish@FIRE 2023: Machine Learning Based Model for Word-level Language Identification in Code-mixed Tulu Texts - Hamada Nayel (Online) slides
14:00-14:45 Scarcasm Identification of Dravidian Languages (Malayalam and Tamil) in DravidianCodeMix 2023 (DravidianCodeMix) Presentation (~5 minutes each)
Session Chair: B Bharathi
  • Sarcasm Identification in Dravidian Languages Tamil and Malayalam-Poorvi Shetty (Online) slides
  • Cross-Linguistic Sarcasm Detection in Tamil and Malayalam: A Multilingual Approach-Dhanya Krishnan (Online) slides
  • Identifying the type of sarcasm in Dravidian Languages using Deep-Learning Models-Ramya Sivakumar (Online) slides
  • Learning Models with Text Augmentation for Sarcasm Detection in Malayalam and Tamil Code-mixed Texts-Asha Hegde slides
  • A Few Shot Learning to Detect Sarcasm in Tamil and Malayalam Code Mixed Data-Shanmitha Thirumoorthy(Online)
  • Sarcasm Detection in Dravidian Languages using Transformer Models-Madhumitha M(Online)
  • Sarcasm Identification In Codemix Dravidian Languages-Kanisha V (Online)
  • Sarcasm Identification of Dravidian Languages (Malayalam and Tamil) - Indirakanth V (Online) slides
  • Sarcasm Detection in Tamil and Malayalam Dravidian Code-Mixed Tex- Anshika Mishra slides
Workshop:
Portuguese presence in Goa in digital perspective (Parallel Session)
  • Project Monsoon: how to use digital techniques to understand the Portuguese presence in Asia Ana Sofia Ribeiro (CIDEHUS – Évora University)
  • Digital Humanities in the understanding of Goan Vernacular Architecture Victor Mestre and Sofia Aleixo (Escola de Artes – Évora University)
  • Venue : Chemistry Auditorium, SCS, Block E, Goa University
14:45-15:00 Tea Break
15:00-15:45 Industry Day Keynote address:
Session Chair: Parth Mehta
  • Saving Languages with AI: The Challenge of Fair and Inclusive Large Language Models - Kalika Bali slides
Coffee break
15:20 Roundtable – using digital techniques to remember Goa history
  • Delfim Correia (Instituto Camões, Goa University)
  • Goa Historical Archive
  • Paulo Quaresma (Évora University)
15:45-16:15 Industry Track Paper (~15 min each)
Session Chair: Parth Mehta
  • Future of Workplace Conversational AI-driven Personal Assistants: Promises and Perils - Koustuv Saha slides
  • On Gradient Boosted Decision Trees and Neural Rankers: A Case-Study on Short-Video Recommendations at ShareChat - Olivier Jeunen


Day 3 : Sunday 17 December
Venue- FF7, First Floor, Goa Business School, Goa University
9:00-9:45 Keynote address:
  • Quantum Computing for Information Access: Is It That Scary?: Nicola Ferro slides
9:45-10:45 Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages (HASOC) Presentation (~5 minutes each)
Session Chair: Sandip Modha
  • Hate and Offensive Content Identification in Indo-Aryan Languages using Transformer-based Models- Ojo Olumide Ebenezer (Online)
  • Multilingual Hate Speech and Offensive Language Detection of Low Resource Languages -Abhinav Reddy Gutha slides
  • Harnessing Pre-Trained Sentence Transformers for Offensive Language Detection in Indian Languages-Ananya Joshi (Online) slides
  • Hate Speech Classification for Sinhalese and Gujarati-Madhuri Sawant (Online) slides
  • Addressing Hate Speech: ATLANTIS for Efficient Hate Span Detection-Yashraj Poddar
  • Crossing Borders: Multilingual Hate Speech Detection-Abhishek Dhaka slides
  • Hate Speech Detection in Low Resource Indo-Aryan Languages-Sougata Saha slides
  • Hate Speech and Offensive Content Detection in Indo-Aryan Languages: A Battle of LSTM and Transformers.-Nikhil Narayan slides
  • Sinhala and Gujarati Hate Speech Detection-Krithik Sathya M slides
  • Enhancing Hate Speech Detection in Sinhala and Gujarati: Leveraging BERT Models and Linguistic Constraints-Aswath Venkatesh (Online) slides
  • Bengali Hate Speech Detection Using Deep Learning Technique-Chandan Senapati (Online) slides
  • Taming Toxicity: Learning Models for Hate Speech and Offensive Language Detection in Social Media Text-Sharal Coelho slides
10:45-11:00 Tea Break
11:00-11:45 Indian Language Summarization (ILSUM) Presentation (~5 minutes each)
Session Chair: Sandip Modha
  • Prompted Zero-Shot Multi-label Classification of Factual Incorrectness in Machine-Generated Summaries-Aniket Deroy slides
  • Named Entity-Aware Abstractive Text Summarization for Hindi Language-Saumay Gupta slides
  • Advancing Human-Like Summarization: Approaches to Text Summarization-Saliq Gowhar(Online) slides
  • Text Summarization for Indian Languages: Finetuned Transformer Model Application-Ilanchezhiyan V (Online)
Machine Translation for Indian Languages (MTIL) Presentation (~5 minutes each)
  • Hindi-Odia Machine Translation System - Mihir Raj slides
  • Bidirectional Hindi-Punjabi Machine Translation-Karunesh Kumar Arora slides
  • Fine tuning based Domain Adaptation for Machine Translation of Low Resource Indic Languages-Harpreet Singh Anand (Online) slides
11:45-12:30 Keynote address:
  • Experimentation and Reproducibility in Information Retrieval: Then and Now: Iadh Ounis slides
12:30-13:15 Lunch Break
13:15-14:15 Artificial Intelligence on Social Media (AISoMe) Presentation (~5 minutes each)
Session Chair: Kripabandhu Ghosh
  • BERT-Powered Multi-label Classifier: Analyzing Public COVID Vaccination Discourse - Ranjit Patro slides
  • Analyzing crowd-sourced vaccine data : Uncovering Concerns and Insights- Lakshmi S Gopal slides
  • Multi-Label Classification of COVID-Tweets Using Large Language Models- Aniket Deroy slides
  • Multi-label Classification of Covid-19 Vaccine Tweet- Sumit as slides
  • VaxTweetClassifier: BERT for Dealing with Vaccination Tweets-Shankha Shubhra Das (Online) slides
  • VaxVedict : A roBERTa based multilabel classifier-Aditya Onkar Patil( Online) slides
  • VaxiBERT: A BERT-Based Classifier for Vaccine Tweets with Multi-Label Annotations - Shivangi Bithel (Online) slides
  • Tweet Classifier: Advancements in Multi-Label Analysis - Swastik Anupam (Online) slides
14:15-15:00 Conference Track : Regular Paper (~15 minutes each)
Session Chair: Debasis Ganguly
  • A Comparative Analysis of Retrievability and PageRank Measures - Priyanshu
  • Expressivity-aware Music Performance Retrieval using Mid-level Perceptual Features and Emotion Word Embeddings - Silvan David Peter

Conference Track : Extended Abstract (~10 minutes each)
  • Fact-based Court Judgment Prediction - Shubham Kumar Nigam
15:00-15:15 Tea Break
15:00-16:00 Industry Day Keynote address
  • Search, Recommenders and Co-pilots: Evolution of Evaluation Strategies in the Industry - Rishabh Mehrotra slides
16:00-16:15 Industry Track Paper (~15 min each)
  • Recommendation Systems in the Era of LLMs - Ipsita Mohanty



Day 4 : Monday 18 December (Tutorial Day)
Track 1 Track 2 Workshop:
9:00-9:30 A hands-on workshop by NVIDIA (Live online) (Parallel) Venue-FF7
9:30-11:00 Tutorial 1: Unleashing the Power of Large Language Models: A Hands-On Tutorial - Madhusudan Ghosh, Payel Samtra, Debasis Ganguly (Offline) & Partha Basuchowdhari, Sudip Kumar Naskar (Online) Venue-GF1 slides
11:15-12:45 Tutorial 3: Recent Advancements in Unbiased Learning to Rank - Shashank Gupta, Philipp Hager, and Harrie Oosterhuis Venue-GF1 Tutorial 4: AI and Data-driven Approaches for Agriculture - Manjira Sinha, Tirthankar Dasgupta, Adway Mitra Venue-FF7
12:00-1:30 Tutorial 2: Explainability of Text Processing and Retrieval Methods - Sourav Saha, Procheta Sen, Avishek Anand, Mandar Mitra (Online) (Parallel) Venue-GF2