FIRE 2024

Forum for Information Retrieval Evaluation

DAIICT , Gandhinagar

12th - 15th December

FIRE

Schedule

All time written are in IST
Day 1 : Thursday, 12 December (Tutorial Day)
Venue - Lecture Theatre 1 (LT1), DAIICT Gandhinagar
9:00 - 9:30	Registration
9:30 - 11:30	Tutorial 1 Evaluating Relation Hallucination in Text Summarization: An Introduction to the Relation Hallucination Index technique - Rakesh Chandra Balabantaray slides
11:45 - 12:45	Tutorial 2 In-Context Learning in LLMs to Improve Retrieval Models - Nilanjan Sinhababu slides
12:45 - 13:45	Lunch Break
13:45 - 14:45	Tutorial 2 In-Context Learning in LLMs to Improve Retrieval Models - Nilanjan Sinhababu slides
14:45 - 16:45	Tutorial 3 Transforming Business Text Processing with Generative AI - Manjira Sinha / Tirthankar Dasgupta

Day 2 : Friday, 13 December
Venue - Lecture Theatre 1 (LT1), DAIICT Gandhinagar
8:30 - 9:00	Registration
9:00 - 9:45	Keynote address: Session Chair: Prasenjit Majumdar Evaluating Search for Systematic Review Creation - Allan Hanbury slides
9:45 - 10:00	Tea Break
10:00 - 11:00	Track overview (~15 minutes each) Session Chair: Thomas Mandl Spoken-Query Cross-Lingual Information Retrieval for the Indic Languages (SqCLIR) - Bhargav Dave slides Indian Language Summarization (ILSUM) - Shreykumar Satapara slides Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages (HASOC) - Thomas Mandl / Shreykumar Satapara slides Code-Mixed Information Retrieval from Social Media Data - Supriya Chanda slides
11:00 - 11:30	Track overview (~15 minutes each) Session Chair: Thomas Mandl CryptOQA: Opinion Extraction and Question Answering from CryptoCurrency-Related Tweets and Reddit posts - Koustav Rudra slides Conversational System for Differential Diagnosis of GI Cancer - Manjira Sinha slides
11:45 - 12:30	Keynote address: Session Chair: Parth Mehta LLMs and IR Evaluation: Towards Building Reusable Conversational Test Collections - Mohammad Alian Nejadi (Online)
12:30 - 12:45	Inaugural session and Group photos
12:45 - 13:30	Lunch Break
13:30 - 14:30	Track overview (~15 minutes each) Session Chair: Thomas Mandl Word-level Language Identification in Dravidian Languages (CoLi-Dravidian) - Sharal Coelho slides Information Retrieval in Software Engineering (IRSE) - Srijoni Majumdar slides Sarcasm Identification of Dravidian Languages Tamil & Malayalam (DravidianCodeMix) - N. Sripriya slides
14:30 - 15:30	Conference Track Presentation(~15 minutes each) Session Chair: Debasis Ganguly A Weighted Retrieval Model for Large Collections under the Exceedance over Relevant Extremes - Dipannita Podder, Jiaul Paik, Pabitra Mitra slides Leveraging In-Context Learning and Retrieval-Augmented Generation for Automatic Question Generation in Educational Domains - Subhankar Maity, Aniket Deroy, Sudeshna Sarkar slides Contrastive Learning-Enhanced BERT Models for Hate Speech Detection in Marathi and Telugu - Devendra Kayande (Online), Kishore Kumar Ponnusamy, Prasanna Kumar Kumaresan, Ruba Priyadharshini, Asoka Chakravarthi, Paul Buitelaar On Importance of Layer Pruning for Smaller BERT Models and Low Resource Languages - Amey Shembade (Online), Raviraj Joshi, Mayur Shirke, Madhushri Wagh, Pavan Thorat
15:30 - 15:45	Tea Break
15:45 - 16:45	Spoken-Query Cross-Lingual Information Retrieval for the Indic Languages (SqCLIR) Presentation (~5 minutes each) Session Chair: Bhargav Dave Spoken Query Retrieval in Monolingual Contexts with Whisper and SBERT Models - Prabhu Ram Nagrajan / Livin slides Code-Mixed Information Retrieval from Social Media Data Presentation (~5 minutes each) Session Chair: Supriya Chanda RetrieveGPT: Merging Prompts and Mathematical Models for Enhanced Code-Mixed Information Retrieval- Aniket Deroy / Subhankar Maity slides InfoTextCM: Addressing code-mixed data retrieval via text classification - Aditya Sharma (Online) slides Track overview (~15 minutes each) Session Chair: Thomas Mandl Personalized Information Retrieval (PIR) - Marco Braga / Pranav Kasela (Online) slides

Day 3 : Saturday 14 December
Venue - Lecture Theatre 1 (LT1), DAIICT Gandhinagar
9:00 - 10:00	Information Retrieval in Software Engineering (IRSE) Presentation (~5 minutes each) Session Chair: Srijoni Majumdar Classification of Code and Comments in a Machine Learning Framework - Adwita Deshpande slides Can we predict Comment Quality using Machine Learning? - Ashwin Gaikwad slides Categorizing Code Comments based on its Relevance for Code Readability - Om Joshi slides Exploring Usefulness of C Comments with Silver-Standard Machine Learning Models- Aritra Mitra (Online) slides Assessing the Utility of C Comments with SVM and Naïve Bayes Classifier - Anamitra Mukhopadhyay (Online) slides Coding Smarter, Not Harder: Leveraging GPT-3.5 Turbo for Automated Code Solution Scoring - subhankar maity slides Doctoral Consortium Presentation (~10 minutes each) Session Chair: Srijoni Majumdar Detecting Deepfakes: Exploring the Frontiers of Deepfake Generation and Detection - Surbhi Raj slides Context-sensitive Dense Structure Extraction in Hybrid Heterogeneous Information Networks - Ajaharul Hoque slides
10:00 - 10:15	Tea Break
10:15 - 11:00	Keynote address: Session Chair: Surupendu Gangopadhyay Evaluating Large Language Models in Legal Domain - Yiqun Liu (Online)
11:00-12:45	Sarcasm Identification of Dravidian Languages Tamil & Malayalam (DravidianCodeMix) Presentation (~5 minutes each) Session Chair: N. Sripriya YouTube Comments Decoded: Leveraging LLMs for Low Resource Language Classification - Aniket Deroy / Subhankar Maity slides Sarcasm Detection and Identification of Dravidian Language using Machine learning Approach - B. Bharathi slides Unmasking Sarcasm: Exploring mBERT+CNN and LSTM Models for Sarcasm Identification in Code-Mixed Tamil and Malayalam Texts - Kavya G slides Sarcasm Identification Of Dravidian Languages (Malayalam and Tamil) - D. Thenmozhi slides Sarcasm Detection in Dravidian Languages for DravidianCodeMix@FIRE - 2024 by Tech-Chasers - Soumyajit Paul (Online) Leveraging ChatGPT and XLM-RoBERTa for Sarcasm Detection in Dravidian Code-Mixed Languages - Krishna Tewari slides UMSNH NLP Team at the Sarcasm Identification of Dravidian Languages Tamil & Malayalam task - Jaime Cerda Flores (Online) A Hybrid Approach to Sarcasm Detection in Dravidian Code-Mixed Texts - Dipanjan Saha (Online) slides
12:45 - 13:30	Lunch Break
13:30 - 14:30	Indian Language Summarization (ILSUM) Presentation (~5 minutes each) Session Chair: Shreykumar Satapara CrossFactual: A Novel Approach for Detecting Factual Inaccuracies in Machine-Generated Summaries - Aniket Deroy / Subhankar Maity slides Text Summarization and Detection of Factual Incorrectness for Indian Languages - D. Thenmozhi slides Indian Language Summarization and Factual Error Detection using Pretrained Sequence-to-Sequence Models and Large Language Models - Abhijith Balan (Online) slides Summarizing English News Articles: Leveraging T5 and Google Gemini 1.0 Pro - D. Thenmozhi slides Overcoming Code-Mixing and Script-Mixing in Indian Language Summarization with Transformer Models - Pulkit Chatwal (Online) slides
14:30 - 15:30	Keynote address: Session Chair: Dr. Tathagata Bandyopadhyay On Soft Permutation, Set Alignment, and Graph Matching - Soumen Chakrabarti slides
15:30 - 15:45	Tea Break
15:45 - 16:15	Industry Track Keynote address: Session Chair: Surupendu Gangopadhyay Navigating the AI Revolution in Industry - Jainam Shah slides
17:15 - 18:15	Steering Committee Meeting
19:00	Banquet - The Fern Residency, Gandhinagar

Day 4 : Sunday, 15 December
Venue - Lecture Theatre 1 (LT1), DAIICT Gandhinagar
9:00 - 10:00	Indian Language Summarization (ILSUM) Presentation (~5 minutes each) Session Chair: Shreykumar Satapara Text Summarization for Indian Languages: Extractive summarization using graph based technique - Ansh Vora slides Enhancing News Article Summarization Through Post-Processing Techniques - Fathima Firose A (Online) slides Assessing Factual Accuracy in Machine Generated Cross Lingual Summaries using Logistic Regression and BERT - Kushaal Shyam Potta (Online) Abstractive Summarization of large articles in Hindi Language using IndicBART - Chaitanya Subhedar (Online) slides Text Summarization using Pre-Trained Models on Tamil, English, Gujarati and Bengali - Tanisha Sriram (Online) Enhancing Accuracy in Indian Language Summarization - Rishika Jha (Online) slides
10:00 - 10:15	Tea Break
10:15 - 11:00	Keynote address: Session Chair: Shreykumar Satapara Hate Speech: Platform Needs, Detection Technologies and Regulation - Thomas Mandl slides
11:00-12:00	Word-level Language Identification in Dravidian Languages Presentation (~5 minutes each) Session Chair: Sharal Coelho Prompt Engineering Using GPT for Word-Level Code-Mixed Language Identification in Low-Resource Dravidian Languages - Aniket Deroy / Subhankar Maity slides Enhancing Word-Level Language Identification in Code-Mixed Dravidian Languages - Kavya G slides Word Level Language Identification in Code-mixed Dravidian Languages - Sharal Coelho slides Finding the Right Language Model Goes a Long Way Towards Accurate Language Identification - Rob van der goot (Online) slides Machine Learning Based Model for Word-level Language Identification in Code-mixed Kannada Texts - Abdollah Abadian (Online) slides
12:00 - 12:45	Keynote address: Session Chair: Sharal Coelho Enhancing Extractive Summarization for Low Resource Indian Languages using TF-IDF and SVD - Sangita Singh (Online) slides Flexible Representations with Learned Sparse Retrieval - Andrew Yates (Online)
12:45 - 13:30	Lunch Break
13:30 - 14:30	Conversational System for Differential Diagnosis of GI CancerTrack Presentation (~5 minutes each) Session Chair: Manjira Sinha Cancer-Answer: Empowering Cancer Care with Advanced Large Language Models - Aniket Deroy / Subhankar Maity slides Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages (HASOC) Presentation (~5 minutes each) Session Chair: Thomas Mandal HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X - Aniket Deroy / Subhankar Maity slides Zero-Shot and Multitask Learning Synergy for Robust Hate Speech Detection across English and Bangla - Kavya G slides
14:30 - 15:30	CryptOQA: Opinion Extraction and Question Answering from CryptoCurrency-Related Tweets and Reddit posts Presentation (~5 minutes each) Session Chair: Koustav Rudra CryptoLLM: Unleashing the Power of Prompted LLMs for SmartQnA and Classification of Crypto Posts - Aniket Deroy / Subhankar Maity slides Navigating Crypto Conversations: A Multi-Level Approach to Classify Cryptocurrency Opinions on Social Media - Kavya G slides CryptoOpinionMining: A Comparative Analysis of Hierarchical and Flat Classification Models for Social Media Content - Rudra Roy slides
15:30 - 15:45	Tea Break
15:45 - 16:45	Conference Paper Presentation(~15 minutes each) Session Chair: Surupendu Gangopadhyay Bilingual Sentiment and Emotion Analysis: A Multi-Task Learning Framework for Bengali and English - Pritam Pal, Dipankar Das, Anup Kolya slides L3Cube-MahaSum: A Comprehensive Dataset and BART Models for Abstractive Text Summarization in Marathi - Nikita Kulkarni, Kareena Manghani, Sanhita Kulkarni, Pranita Deshmukh, Raviraj Joshi slides Learning Query Token Importance for Effective Document Retrieval with Verbose Queries - Dipannita Podder, Jiaul Paik, Pabitra Mitra slides

To be announced soon.