كل أفكار المشروعات
200 Advanced NLP and Computer Vision Project Ideas
Natural Language Processing (NLP) Projects
1. Multilingual, Multi-task Transformer for Low-resource Languages
Overview: Develop a transformer model that can handle multiple NLP tasks across various low-resource languages simultaneously, leveraging shared knowledge to improve performance where data is scarce.
Resources:
- Paper: "Massively Multilingual Transfer for NER" (Rahimi et al., 2019)
- Paper: "Cross-lingual Transfer Learning for POS Tagging without Cross-Lingual Resources" (Kim et al., 2017)
- GitHub: Universal Dependencies - https://github.com/UniversalDependencies
2. Neural Machine Translation with Adaptive Vocabulary Compression
Overview: Create a translation system that dynamically compresses and adapts its vocabulary based on the input text, optimizing memory usage and translation speed for resource-constrained environments.
Resources:
- Paper: "Vocabulary Manipulation for Neural Machine Translation" (Sennrich et al., 2016)
- Paper: "Dynamic Sentence Sampling for Efficient Training of Neural Machine Translation" (Wang et al., 2018)
- GitHub: OpenNMT - https://github.com/OpenNMT/OpenNMT-py
3. Context-aware Sarcasm Detection in Social Media Conversations
Overview: Build a model that analyzes the broader context of social media conversations, including user history and thread structure, to accurately identify sarcastic comments and posts.
Resources:
- Paper: "A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks" (Ghosh & Veale, 2016)
- Paper: "Contextual Sarcasm Detection in Online Discussions" (Ghosh et al., 2018)
- Dataset: SemEval-2018 Task 3: Irony detection in English tweets
4. Adversarial Training for Robust Question Answering Systems
Overview: Enhance question answering models by training them with adversarial examples, improving their performance on challenging and manipulated inputs to increase real-world reliability.
Resources:
- Paper: "Adversarial Examples for Evaluating Reading Comprehension Systems" (Jia & Liang, 2017)
- Paper: "Robust Reading Comprehension with Linguistic Constraints via Adversarial Training" (Zhou et al., 2020)
- GitHub: AllenNLP - https://github.com/allenai/allennlp
5. Cross-lingual Knowledge Graph Completion and Reasoning
Overview: Develop a system that can complete and reason over knowledge graphs across multiple languages, bridging information gaps between different linguistic knowledge bases and enabling cross-lingual inference.
Resources:
- Paper: "Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks" (Xu et al., 2019)
- Paper: "Cross-lingual Knowledge Graph Embedding for Entity Alignment" (Chen et al., 2017)
- Dataset: DBpedia - https://wiki.dbpedia.org/
6. Multimodal Emotion Recognition in Video Conversations
Overview: Create a model that combines facial expressions, voice tone, and textual content to accurately recognize emotions in video conversations, enabling more nuanced human-computer interaction.
Resources:
- Paper: "Context-Dependent Sentiment Analysis in User-Generated Videos" (Poria et al., 2017)
- Paper: "Multimodal Sentiment Analysis: Addressing Key Issues and Setting Up the Baselines" (Soleymani et al., 2017)
- Dataset: CMU-MOSEI (Multimodal Opinion Sentiment and Emotion Intensity)
7. Few-shot Learning for Domain-specific Named Entity Recognition
Overview: Design a named entity recognition system that can quickly adapt to new domains with minimal labeled data, using few-shot learning techniques to recognize domain-specific entities efficiently.
Resources:
- Paper: "Few-Shot Named Entity Recognition: A Comprehensive Study" (Huang et al., 2020)
- Paper: "Prototypical Networks for Few-shot Learning" (Snell et al., 2017)
- GitHub: FewNERD - https://github.com/thunlp/Few-NERD
8. Hierarchical Attention Networks for Document Classification
Overview: Implement a document classification model using hierarchical attention mechanisms to capture document structure at different levels (words, sentences, paragraphs), improving classification accuracy for long documents.
Resources:
- Paper: "Hierarchical Attention Networks for Document Classification" (Yang et al., 2016)
- Paper: "Document Modeling with Gated Recurrent Neural Network for Sentiment Classification" (Tang et al., 2015)
- GitHub: Keras implementation - https://github.com/richliao/textClassifier
9. Neural Conversation Model with Personality and Emotion Control
Overview: Develop a chatbot that can generate responses with controllable personality traits and emotions, creating more engaging and context-appropriate conversations for various applications.
Resources:
- Paper: "Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory" (Zhou et al., 2018)
- Paper: "Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset" (Rashkin et al., 2019)
- GitHub: ParlAI - https://github.com/facebookresearch/ParlAI
10. Abstractive Text Summarization with Reinforcement Learning
Overview: Create a summarization model that uses reinforcement learning to generate concise, coherent, and informative summaries of long documents, optimizing for readability and information retention.
Resources:
- Paper: "A Deep Reinforced Model for Abstractive Summarization" (Paulus et al., 2017)
- Paper: "Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting" (Chen & Bansal, 2018)
- GitHub: OpenNMT Summarization - https://github.com/OpenNMT/OpenNMT-py/tree/master/examples/summarization
11. Multilingual Code-switching Detection and Language Identification
Overview: Build a system that can detect and identify multiple languages within a single text or conversation, handling code-switching scenarios common in multilingual communities.
Resources:
- Paper: "Language Identification and Analysis of Code-Switched Social Media Text" (Solorio et al., 2014)
- Paper: "Code-Switching Language Modeling using Syntax-Aware Multi-Task Learning" (Pratapa et al., 2018)
- Dataset: CALCS - Computational Approaches to Linguistic Code-Switching
12. Aspect-based Sentiment Analysis with Graph Neural Networks
Overview: Develop a model using graph neural networks to perform fine-grained sentiment analysis, identifying sentiments associated with specific aspects of products or services in reviews.
Resources:
- Paper: "Aspect-Based Sentiment Classification with Aspect-Specific Graph Convolutional Networks" (Wang et al., 2020)
- Paper: "Aspect-Level Sentiment Classification with Heat (Hierarchical Attention) Network" (Li et al., 2018)
- GitHub: PyTorch Geometric - https://github.com/rusty1s/pytorch_geometric
13. Unsupervised Style Transfer in Text with Cycle-Consistency
Overview: Create a text style transfer system that can change the style of text (e.g., formal to casual) while preserving content, using cycle-consistency to ensure meaningful transformations without parallel data.
Resources:
- Paper: "Style Transfer from Non-Parallel Text by Cross-Alignment" (Shen et al., 2017)
- Paper: "Unsupervised Text Style Transfer using Language Models as Discriminators" (Yang et al., 2018)
- GitHub: Text Style Transfer - https://github.com/fastnlp/style-transfer
14. Multimodal Machine Translation (Text, Image, and Speech)
Overview: Design a translation system that incorporates text, images, and speech to provide more accurate and context-aware translations, particularly useful for multimedia content.
Resources:
- Paper: "Multi-Modal Machine Translation with Embedding Prediction" (Calixto & Liu, 2019)
- Paper: "Grounded Sequence to Sequence Transduction" (Su et al., 2019)
- Dataset: Multi30K - https://github.com/multi30k/dataset
15. Continual Learning for Adaptive Dialogue Systems
Overview: Develop a dialogue system that can continuously learn and adapt to new topics and user preferences over time, without forgetting previously learned information.
Resources:
- Paper: "Continual Learning of New User Intents for a Dialogue System" (Lee, 2017)
- Paper: "Lifelong Learning for Dialogue State Tracking" (Mazumder et al., 2019)
- GitHub: ConvLab-2 - https://github.com/thu-coai/ConvLab-2
16. Zero-shot Cross-lingual Transfer for NLP Tasks
Overview: Create a model capable of performing NLP tasks in languages it hasn't been explicitly trained on, leveraging knowledge from seen languages to generalize to unseen ones.
Resources:
- Paper: "Zero-Shot Cross-Lingual Transfer with Meta Learning" (Nooralahzadeh et al., 2020)
- Paper: "Cross-Lingual Transfer Learning for POS Tagging without Cross-Lingual Resources" (Kim et al., 2017)
- GitHub: XTREME benchmark - https://github.com/google-research/xtreme
17. Fact Verification and Claim Detection in Scientific Literature
Overview: Build a system to automatically verify factual claims in scientific papers and detect novel claims, aiding in literature review and fact-checking processes.
Resources:
- Paper: "SciFact: Claim Verification for Scientific Literature" (Wadden et al., 2020)
- Paper: "Automated Fact-Checking of Claims from Wikipedia" (Thorne et al., 2018)
- Dataset: FEVER - Fact Extraction and VERification
18. Neural Topic Modeling with Hierarchical Attention
Overview: Implement a topic modeling approach using neural networks and hierarchical attention mechanisms to discover and represent topics in large document collections more accurately.
Resources:
- Paper: "Neural Topic Models with Dynamic Word Embeddings" (Dieng et al., 2020)
- Paper: "Hierarchical Attention Topic Model for Document Classification" (Yang et al., 2020)
- GitHub: Neural Topic Modeling - https://github.com/zll17/Neural_Topic_Models
19. Multitask Learning for Grammatical Error Correction and Paraphrasing
Overview: Develop a model that simultaneously corrects grammatical errors and generates paraphrases, improving both the correctness and diversity of written text.
Resources:
- Paper: "Multi-Task Learning for Grammatical Error Correction" (Yuan et al., 2019)
- Paper: "Paraphrasing with Large Language Models" (Witteveen & Andrews, 2019)
- Dataset: JFLEG (JHU FLuency-Extended GUG) corpus
20. Explainable AI for Legal Document Analysis and Case Prediction
Overview: Create an interpretable AI system for analyzing legal documents and predicting case outcomes, providing explanations for its decisions to aid legal professionals.
Resources:
- Paper: "Explainable Artificial Intelligence for Legal Applications" (Branting et al., 2019)
- Paper: "Legal Judgment Prediction via Multi-Perspective Bi-Feedback Network" (Zhong et al., 2020)
- Dataset: LEDGAR - Legal Dataset for Global AI Regulation
21. Controllable Text Generation with Logical Constraints
Overview: Design a text generation system that can produce content adhering to specific logical constraints, ensuring consistency and factual accuracy in the generated text.
Resources:
- Paper: "Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems" (Wen et al., 2015)
- Paper: "Constrained Language Models Yield Few-Shot Semantic Parsers" (Shin et al., 2021)
- GitHub: Hugging Face Transformers - https://github.com/huggingface/transformers
22. Cross-domain Sentiment Analysis with Domain Adaptation
Overview: Develop a sentiment analysis model that can adapt to new domains with minimal labeled data, transferring knowledge from source domains to target domains effectively.
Resources:
- Paper: "Adversarial Domain Adaptation for Sentiment Classification" (Li et al., 2017)
- Paper: "Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization" (Yang et al., 2017)
- Dataset: Amazon reviews dataset (multi-domain sentiment analysis)
23. Multimodal Named Entity Disambiguation in Social Media
Overview: Create a system that uses text, images, and user network information to disambiguate named entities in social media posts, improving entity linking in noisy, informal contexts.
Resources:
- Paper: "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (Zhang et al., 2018)
- Paper: "Multi-Modal Fusion for Named Entity Recognition in Social Media" (Moon et al., 2018)
- Dataset: WNUT - Workshop on Noisy User-generated Text
24. Adversarial Text Generation for Data Augmentation in NLP
Overview: Implement a method for generating adversarial text examples to augment training data for NLP tasks, enhancing the robustness of models against potential attacks or unusual inputs.
Resources:
- Paper: "Adversarial Training Methods for Semi-Supervised Text Classification" (Miyato et al., 2016)
- Paper: "Adversarial Examples for Evaluating Reading Comprehension Systems" (Jia & Liang, 2017)
- GitHub: TextAttack - https://github.com/QData/TextAttack
25. Automatic Code Generation from Natural Language Specifications
Overview: Build a system that can generate executable code from natural language descriptions of desired functionality, bridging the gap between human ideas and programming implementation.
Resources:
- Paper: "Learning to Generate Pseudo-Code from Source Code Using Statistical Machine Translation" (Oda et al., 2015)
- Paper: "Latent Predictor Networks for Code Generation" (Ling et al., 2016)
- Dataset: CoNaLa - The Code/Natural Language Challenge
26. Neural Metaphor Detection and Interpretation
Overview: Develop a model capable of identifying metaphorical expressions in text and interpreting their meaning, enhancing natural language understanding in creative and figurative contexts.
Resources:
- Paper: "Neural Metaphor Detection in Context" (Gao et al., 2018)
- Paper: "Metaphor Detection Using Ensembles of Bidirectional Recurrent Neural Networks" (Wu et al., 2018)
- Dataset: VU Amsterdam Metaphor Corpus
27. Multilingual Hate Speech Detection with Contextual Embeddings
Overview: Create a hate speech detection system that works across multiple languages, using contextual embeddings to capture nuanced and culture-specific expressions of hate speech.
Resources:
- Paper: "Multilingual and Multi-Aspect Hate Speech Analysis" (Ousidhoum et al., 2019)
- Paper: "Cross-Lingual Transfer Learning for Hate Speech Detection" (Pamungkas & Patti, 2019)
- Dataset: HatEval - Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter
28. Graph-based Text Summarization for Scientific Papers
Overview: Implement a summarization approach that represents scientific papers as knowledge graphs and uses graph algorithms to generate concise, informative summaries of research content.
Resources:
- Paper: "Discourse-Aware Neural Extractive Text Summarization" (Xu et al., 2020)
- Paper: "Bringing Structure into Summaries: Crowdsourcing a Benchmark Corpus of Concept Maps" (Falke et al., 2017)
- Dataset: ScisummNet - A Large Annotated Corpus for Scientific Paper Summarization
29. Few-shot Learning for Intent Classification in Conversational AI
Overview: Design an intent classification system for chatbots that can quickly learn to recognize new intents with only a few examples, allowing for rapid adaptation to new domains or user needs.
Resources:
- Paper: "Few-Shot Text Classification with Distributional Signatures" (Bao et al., 2020)
- Paper: "Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks" (Bansal et al., 2020)
- GitHub: ConvAI3 - https://github.com/DeepPavlov/convai
30. Unsupervised Cross-lingual Word Embedding Alignment
Overview: Develop a method for aligning word embeddings across languages without parallel data, enabling cross-lingual transfer of NLP models and multilingual applications.
Resources:
- Paper: "Unsupervised Word Translation Pairs" (Conneau et al., 2018)
- Paper: "Unsupervised Multilingual Word Embeddings" (Chen & Cardie, 2018)
- Dataset: MUSE - Multilingual Unsupervised and Supervised Embeddings
31. Multimodal Fake News Detection (Text, Image, and User Behavior)
Overview: Create a system that combines analysis of text content, image manipulation detection, and user sharing patterns to identify and flag potential fake news articles more accurately.
Resources:
- Paper: "EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection" (Wang et al., 2018)
- Paper: "Multimodal Analytics for Real-world News using Measures of Cross-modal Consistency" (Singhal et al., 2019)
- Dataset: FakeNewsNet - A Data Repository with News Content, Social Context, and Spatiotemporal Information
32. Neural Coreference Resolution with Higher-order Inference
Overview: Implement a coreference resolution model that uses higher-order inference to resolve complex coreference chains, improving accuracy in long documents with multiple entities.
Resources:
- Paper: "Higher-order Coreference Resolution with Coarse-to-fine Inference" (Lee et al., 2018)
- Paper: "BERT for Coreference Resolution: Baselines and Analysis" (Joshi et al., 2019)
- Dataset: OntoNotes 5.0 - Large-scale Multilingual Coreference Dataset
33. Automated Essay Scoring with Hierarchical Attention Networks
Overview: Develop an automated essay scoring system using hierarchical attention networks to capture essay structure and content quality at multiple levels, providing detailed feedback to writers.
Resources:
- Paper: "Automated Essay Scoring with Discourse-Aware Neural Models" (Nadeem et al., 2019)
- Paper: "Co-Attention Based Neural Network for Source-Dependent Essay Scoring" (Zhang & Litman, 2018)
- Dataset: ASAP - Automated Student Assessment Prize
34. Cross-lingual Aspect-based Sentiment Analysis
Overview: Build a model capable of performing aspect-based sentiment analysis across multiple languages, transferring knowledge from resource-rich languages to low-resource ones.
Resources:
- Paper: "Weakly Supervised Cross-lingual Aspect-based Sentiment Analysis" (Jebbara & Cimiano, 2019)
- Paper: "Cross-lingual Aspect-based Sentiment Analysis with Aspect Term Code-Switching" (Li et al., 2020)
- Dataset: SemEval-2016 Task 5: Aspect-based Sentiment Analysis
35. Controllable Story Generation with Plot Graphs
Overview: Create a story generation system that uses plot graphs to control narrative structure and ensure coherent, logically consistent storylines in generated text.
Resources:
- Paper: "Plot Induction and Evolutionary Search for Story Generation" (Li et al., 2013)
- Paper: "Plan-And-Write: Towards Better Automatic Storytelling" (Yao et al., 2019)
- Dataset: ROCStories Corpora - Commonsense Stories
36. Multilingual Question Generation for Reading Comprehension
Overview: Develop a system that can automatically generate questions in multiple languages from given texts, useful for creating educational materials and reading comprehension tests.
Resources:
- Paper: "Learning to Ask: Neural Question Generation for Reading Comprehension" (Du et al., 2017)
- Paper: "Improving Neural Question Generation using Answer Separation" (Kim et al., 2019)
- Dataset: SQuAD - Stanford Question Answering Dataset (for English, but can be extended to other languages)
37. Unsupervised Grammar Induction from Raw Text
Overview: Implement a method for inducing grammatical structures from unannotated text corpora, potentially uncovering linguistic patterns and aiding in language documentation efforts.
Resources:
- Paper: "Unsupervised Neural Hidden Markov Models" (Tran et al., 2016)
- Paper: "Unsupervised Learning of PCFGs with Normalizing Flow" (Jin et al., 2019)
- Dataset: Penn Treebank (for evaluation)
38. Neural Text Simplification with Readability Control
Overview: Design a text simplification model that can adjust the complexity of output text to match desired readability levels, making content more accessible to diverse audiences.
Resources:
- Paper: "Controllable Text Simplification with Lexical Constraint Loss" (Nishihara et al., 2019)
- Paper: "Neural Text Simplification with Explicit Readability Control" (Nishihara et al., 2020)
- Dataset: Newsela Corpus - English Language News Articles
39. Cross-lingual Information Retrieval with Dense Representations
Overview: Create an information retrieval system using dense vector representations to enable effective cross-lingual search, allowing users to find relevant documents across language barriers.
Resources:
- Paper: "From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers" (Hu et al., 2020)
- Paper: "Cross-lingual Retrieval for Iterative Self-Supervised Training" (Tran et al., 2020)
- Dataset: CLEF - Cross-Language Evaluation Forum datasets
40. Multimodal Dialogue State Tracking for Task-oriented Systems
Overview: Develop a dialogue state tracking model that incorporates multiple input modalities (text, speech, images) to more accurately maintain the state of task-oriented conversations.
Resources:
- Paper: "Multimodal Dialogue State Tracking By QA Approach with Data Augmentation" (Quan & Xiong, 2020)
- Paper: "MultiWOZ 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines" (Eric et al., 2020)
- Dataset: MultiWOZ - Multi-Domain Wizard-of-Oz dataset
41. Few-shot Learning for Semantic Role Labeling
Overview: Implement a semantic role labeling system that can quickly adapt to new domains or languages with limited labeled data, using few-shot learning techniques.
Resources:
- Paper: "Few-Shot Semantic Role Labeling with Prototype Learning" (Huang et al., 2020)
- Paper: "Cross-Lingual Transfer Learning for Semantic Role Labeling" (Daza & Frank, 2019)
- Dataset: PropBank - Proposition Bank
42. Adversarial Training for Robust Text Classification
Overview: Design a text classification model that uses adversarial training to improve robustness against potential attacks or domain shifts, ensuring reliable performance in real-world scenarios.
Resources:
- Paper: "Adversarial Training Methods for Semi-Supervised Text Classification" (Miyato et al., 2017)
- Paper: "FreeLB: Enhanced Adversarial Training for Natural Language Understanding" (Zhu et al., 2020)
- Dataset: GLUE Benchmark - General Language Understanding Evaluation
43. Neural Machine Translation with Unsupervised Subword Segmentation
Overview: Create a translation system that learns optimal subword segmentation in an unsupervised manner, adapting to different languages and domains without relying on predefined tokenization rules.
Resources:
- Paper: "Unsupervised Word Segmentation for Neural Machine Translation" (Kudo, 2018)
- Paper: "BPE-Dropout: Simple and Effective Subword Regularization" (Provilkov et al., 2020)
- Dataset: WMT - Conference on Machine Translation datasets
44. Multilingual Offensive Language Identification in Social Media
Overview: Develop a model for detecting offensive language across multiple languages in social media content, considering cultural context and cross-lingual patterns of offensive expression.
Resources:
- Paper: "Offensive Language Identification across Multilingual Contexts" (Zampieri et al., 2020)
- Paper: "Cross-lingual Transfer Learning for Multilingual Task-oriented Dialog" (Schuster et al., 2019)
- Dataset: OffensEval - Identifying and Categorizing Offensive Language in Social Media
45. Graph-based Relation Extraction from Biomedical Literature
Overview: Implement a relation extraction system that uses graph-based representations of biomedical literature to identify and extract complex relationships between entities, aiding in knowledge discovery.
Resources:
- Paper: "Graph Neural Networks with Generated Parameters for Relation Extraction" (Zhu et al., 2019)
- Paper: "Cross-Sentence N-ary Relation Extraction with Graph LSTMs" (Peng et al., 2017)
- Dataset: BioCreative VI ChemProt - Chemical-Protein Interactions
46. Controllable Text Style Transfer with Disentangled Latent Representations
Overview: Create a text style transfer model that disentangles content and style in latent space, allowing for fine-grained control over multiple aspects of text style while preserving content.
Resources:
- Paper: "Multiple-Attribute Text Rewriting" (Lample et al., 2019)
- Paper: "A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfer" (Wu et al., 2019)
- Dataset: Yelp Reviews Dataset (for sentiment transfer)
47. Cross-lingual Stance Detection in Political Discourse
Overview: Build a stance detection system that can identify and classify political positions across different languages, enabling cross-cultural analysis of political discourse.
Resources:
- Paper: "Cross-Lingual Stance Detection" (Taulé et al., 2017)
- Paper: "Multilingual Stance Detection: The Catalonia Independence Corpus" (Zotova et al., 2020)
- Dataset: SemEval-2016 Task 6: Detecting Stance in Tweets
48. Multimodal Irony Detection in Social Media Posts
Overview: Develop a model that combines text analysis with image understanding to detect irony in social media posts, capturing both verbal and visual cues that contribute to ironic expressions.
Resources:
- Paper: "Multimodal Sarcasm Detection in Twitter: A Context-Aware Approach" (Cai et al., 2019)
- Paper: "A Multi-modal Approach to Fine-grained Opinion Mining on Video Reviews" (Garcia et al., 2019)
- Dataset: Twitter Multimodal Corpus for Detecting Irony and Sarcasm
49. Unsupervised Abstractive Meeting Summarization
Overview: Create an abstractive summarization system for meeting transcripts that can generate concise, informative summaries without relying on labeled training data.
Resources:
- Paper: "Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximization" (Shang et al., 2018)
- Paper: "Abstractive Meeting Summarization via Hierarchical Adaptive Segmental Network Learning" (Li et al., 2019)
- Dataset: AMI Corpus - Augmented Multi-party Interaction Corpus
50. Zero-shot Learning for Cross-lingual Event Extraction
Overview: Implement an event extraction system that can identify and classify events in languages it hasn't been explicitly trained on, leveraging cross-lingual representations and transfer learning.
Resources:
- Paper: "Cross-lingual Structure Transfer for Relation and Event Extraction" (Subburathinam et al., 2019)
- Paper: "Zero-Shot Transfer Learning for Event Extraction" (Huang et al., 2018)
- Dataset: ACE 2005 Multilingual Training Corpus
51. Neural Language Models for Code Completion and Bug Detection
Overview: Develop a language model specialized for programming languages that can provide intelligent code completion suggestions and identify potential bugs or code smells.
Resources:
- Paper: "IntelliCode Compose: Code Generation Using Transformer" (Svyatkovskiy et al., 2020)
- Paper: "Learning to Spot and Refactor Inconsistent Method Names" (Liu et al., 2019)
- Dataset: GitHub Code Corpus
52. Multimodal Sentiment Analysis in Video Reviews
Overview: Create a sentiment analysis system that combines visual, audio, and textual features to accurately determine sentiment in video product reviews.
Resources:
- Paper: "Multimodal Sentiment Analysis: Addressing Key Issues and Setting Up the Baselines" (Poria et al., 2018)
- Paper: "M-BERT: Injecting Multimodal Information in the BERT Structure" (Rahman et al., 2020)
- Dataset: CMU-MOSI (Multimodal Opinion Sentiment and Emotion Intensity)
53. Few-shot Learning for Multilingual Text Classification
Overview: Design a text classification model that can quickly adapt to new languages or domains with minimal labeled data, using few-shot learning techniques to transfer knowledge across languages.
Resources:
- Paper: "Few-Shot Text Classification with Distributional Signatures" (Bao et al., 2020)
- Paper: "Meta-Learning for Low-Resource Natural Language Generation in Task-Oriented Dialogue Systems" (Mi et al., 2019)
- Dataset: XNLI (Cross-lingual Natural Language Inference)
54. Unsupervised Keyphrase Extraction with Graph Neural Networks
Overview: Implement a keyphrase extraction method using graph neural networks to identify important phrases in documents without relying on labeled training data.
Resources:
- Paper: "Bringing Structure into Summaries: Crowdsourcing a Benchmark Corpus of Concept Maps" (Falke et al., 2017)
- Paper: "SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model" (Sun et al., 2020)
- Dataset: Inspec Dataset for Keyphrase Extraction
55. Cross-lingual Transfer Learning for Low-resource Languages
Overview: Develop techniques for transferring knowledge from high-resource languages to improve NLP model performance in low-resource languages, addressing the data scarcity problem.
Resources:
- Paper: "Cross-Lingual Language Model Pretraining" (Conneau & Lample, 2019)
- Paper: "Unsupervised Cross-lingual Representation Learning at Scale" (Conneau et al., 2020)
- Dataset: Universal Dependencies Treebanks
56. Adversarial Attacks and Defenses for Text Classification Models
Overview: Research and implement both attack methods to fool text classification models and defense strategies to make models more robust against such attacks.
Resources:
- Paper: "Adversarial Training Methods for Semi-Supervised Text Classification" (Miyato et al., 2017)
- Paper: "Certified Robustness to Adversarial Word Substitutions" (Jia et al., 2019)
- Dataset: IMDB Movie Reviews Dataset
57. Neural Query Expansion for Information Retrieval
Overview: Create a query expansion system using neural networks to improve the effectiveness of information retrieval by automatically enriching user queries with relevant terms.
Resources:
- Paper: "Context-Aware Term Weighting For First Stage Passage Retrieval" (Dai & Callan, 2020)
- Paper: "Neural Query Expansion for BERT Reranking" (Zheng et al., 2020)
- Dataset: MS MARCO Passage Ranking
58. Multilingual Abstractive Summarization with Cross-lingual Pretraining
Overview: Develop an abstractive summarization model that can generate summaries in multiple languages, leveraging cross-lingual pretraining to improve performance across languages.
Resources:
- Paper: "MLSUM: The Multilingual Summarization Corpus" (Scialom et al., 2020)
- Paper: "XLSum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" (Hasan et al., 2021)
- Dataset: MLSUM (Multilingual Summarization Corpus)
59. Graph-based Fake News Detection in Social Networks
Overview: Implement a fake news detection system that uses graph-based representations of information propagation in social networks to identify and flag potential misinformation.
Resources:
- Paper: "FANG: Leveraging Social Context for Fake News Detection Using Graph Representation" (Nguyen et al., 2020)
- Paper: "dEFEND: Explainable Fake News Detection" (Shu et al., 2019)
- Dataset: FakeNewsNet
60. Few-shot Learning for Relation Extraction in Specialized Domains
Overview: Design a relation extraction system that can quickly adapt to new specialized domains (e.g., legal, medical) with limited labeled data using few-shot learning techniques.
Resources:
- Paper: "FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation" (Han et al., 2018)
- Paper: "Meta-Learning for Low-Resource Natural Language Generation in Task-Oriented Dialogue Systems" (Mi et al., 2019)
- Dataset: FewRel Dataset
61. Unsupervised Neural Machine Translation for Rare Language Pairs
Overview: Develop a machine translation system that can work with rare language pairs without parallel corpora, using unsupervised techniques to learn translations from monolingual data.
Resources:
- Paper: "Unsupervised Neural Machine Translation" (Artetxe et al., 2018)
- Paper: "Unsupervised Machine Translation Using Monolingual Corpora Only" (Lample et al., 2018)
- Dataset: WMT Monolingual News Crawl
62. Multimodal Named Entity Recognition in Social Media Posts
Overview: Create a named entity recognition system that combines text analysis with image understanding to identify and classify entities in multimodal social media content.
Resources:
- Paper: "Multimodal Named Entity Recognition for Short Social Media Posts" (Moon et al., 2018)
- Paper: "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (Zhang et al., 2018)
- Dataset: WNUT 2017 Emerging Entities Dataset
63. Controllable Text Generation with External Knowledge Integration
Overview: Implement a text generation system that can incorporate external knowledge sources (e.g., knowledge graphs) to produce factually accurate and contextually relevant content.
Resources:
- Paper: "CTRL: A Conditional Transformer Language Model for Controllable Generation" (Keskar et al., 2019)
- Paper: "Knowledge-Grounded Dialogue Generation with Pre-trained Language Models" (Zhao et al., 2020)
- Dataset: Wikidata Knowledge Graph
64. Cross-lingual Zero-shot Transfer for Sentiment Analysis
Overview: Develop a sentiment analysis model that can perform well on languages it hasn't been explicitly trained on, using zero-shot transfer techniques to leverage knowledge from seen languages.
Resources:
- Paper: "Zero-Shot Cross-Lingual Sentiment Classification with Multilingual Neural Language Models" (Chi et al., 2020)
- Paper: "Cross-Lingual Sentiment Classification with Bilingual Document Representation Learning" (Zhou et al., 2016)
- Dataset: Amazon Reviews Dataset (Multilingual)
65. Adversarial Training for Robust Machine Translation
Overview: Design a machine translation system that uses adversarial training to improve robustness against input perturbations and domain shifts, ensuring reliable performance in diverse scenarios.
Resources:
- Paper: "Robust Neural Machine Translation with Doubly Adversarial Inputs" (Cheng et al., 2019)
- Paper: "Towards Making the Most of BERT in Neural Machine Translation" (Zhu et al., 2020)
- Dataset: WMT Translation Task Datasets
66. Neural Text Normalization for Social Media Language
Overview: Create a text normalization system that can handle the informal and often non-standard language used in social media, improving the performance of downstream NLP tasks on social media data.
Resources:
- Paper: "Lexical Normalization for Social Media Text" (Han & Baldwin, 2011)
- Paper: "MoNoise: A Multi-lingual and Easy-to-use Lexical Normalization Tool" (van der Goot & van Noord, 2017)
- Dataset: LexNorm2015 Dataset
67. Multilingual Emotion Classification with Transfer Learning
Overview: Implement an emotion classification model that can work across multiple languages, using transfer learning techniques to leverage emotional patterns learned from high-resource languages.
Resources:
- Paper: "Multilingual and Multi-Aspect Hate Speech Analysis" (Ousidhoum et al., 2019)
- Paper: "Cross-Lingual Emotion Intensity Prediction" (Abdaoui et al., 2020)
- Dataset: SemEval-2018 Task 1: Affect in Tweets (Multilingual)
68. Graph-based Question Answering over Knowledge Bases
Overview: Develop a question answering system that uses graph-based representations of knowledge bases to answer complex, multi-hop questions requiring reasoning over multiple facts.
Resources:
- Paper: "Complex Query Answering with Neural Link Predictors" (Ren et al., 2020)
- Paper: "PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Text" (Sun et al., 2019)
- Dataset: WebQuestionsSP
69. Few-shot Learning for Dialogue Act Classification
Overview: Design a dialogue act classification system that can quickly adapt to new domains or conversation types with limited labeled data, using few-shot learning techniques.
Resources:
- Paper: "Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach" (Shalyminov et al., 2019)
- Paper: "ToD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue" (Wu et al., 2020)
- Dataset: Switchboard Dialog Act Corpus
70. Unsupervised Bilingual Lexicon Induction with Graph Neural Networks
Overview: Create a method for inducing bilingual lexicons without parallel corpora, using graph neural networks to capture cross-lingual word similarities in embedding spaces.
Resources:
- Paper: "A Robust Self-Learning Method for Fully Unsupervised Cross-Lingual Mappings of Word Embeddings" (Artetxe et al., 2018)
- Paper: "Unsupervised Bilingual Lexicon Induction via Latent Variable Models" (Zhang et al., 2017)
- Dataset: FastText Word Embeddings for Multiple Languages
-
Multimodal Sarcasm Detection in Online Conversations
Overview: Implement a sarcasm detection system that combines text analysis, tone of voice (for audio), and visual cues to identify sarcastic expressions in online multimedia conversations.
-
Controllable Paraphrase Generation with Semantic Constraints
Overview: Develop a paraphrase generation system that can produce diverse paraphrases while adhering to specific semantic constraints, ensuring meaning preservation and style variation.
-
Cross-lingual Summarization for Low-resource Language Pairs
Overview: Create a summarization system that can generate summaries in a low-resource target language given input documents in a high-resource source language, addressing the data scarcity problem.
-
Adversarial Examples for Testing Robustness of NLP Models
Overview: Research and implement methods for generating adversarial examples that can effectively test and expose vulnerabilities in various NLP models, aiding in the development of more robust systems.
-
Neural Code Search with Natural Language Queries
Overview: Design a code search system that can understand natural language queries and retrieve relevant code snippets from large codebases, bridging the gap between natural language and programming languages.
-
Multilingual Named Entity Linking with Zero-shot Transfer
Overview: Implement a named entity linking system that can work across multiple languages, including those not seen during training, by leveraging zero-shot transfer learning techniques.
-
Graph-based Text Generation for Data-to-Text Tasks
Overview: Develop a text generation system that uses graph-based representations of input data to generate coherent and accurate textual descriptions for data-to-text applications.
-
Few-shot Learning for Aspect-based Sentiment Analysis
Overview: Create an aspect-based sentiment analysis model that can quickly adapt to new domains or product categories with limited labeled data using few-shot learning techniques.
-
Unsupervised Domain Adaptation for Text Classification
Overview: Design a text classification system that can adapt to new domains without labeled target domain data, using unsupervised domain adaptation techniques to bridge the domain gap.
-
Multimodal Machine Translation with Visual Grounding
Overview: Implement a machine translation system that incorporates visual information to improve translation accuracy, especially for ambiguous terms or phrases that benefit from visual context.
-
Controllable Dialogue Generation with Persona and Emotion
Overview: Develop a dialogue system that can generate responses with controllable persona traits and emotions, creating more engaging and context-appropriate conversations in various applications.
-
Cross-lingual Question Answering with Minimal Supervision
Overview: Create a question answering system that can work across multiple languages with minimal supervision, leveraging transfer learning and cross-lingual representations.
-
Adversarial Training for Robust Dialogue Systems
Overview: Design dialogue systems that use adversarial training techniques to improve robustness against unexpected inputs, ensuring more reliable performance in real-world conversations.
-
Neural Text Coherence Modeling and Evaluation
Overview: Develop models for measuring and improving the coherence of generated or human-written texts, enhancing the quality and readability of various text generation tasks.
-
Multilingual Authorship Attribution with Stylometric Features
Overview: Implement an authorship attribution system that works across multiple languages, using stylometric features and transfer learning to identify authors based on their writing style.
-
Graph-based Argument Mining in Scientific Literature
Overview: Create a system for automatically extracting and analyzing argumentative structures in scientific papers, using graph-based representations to capture complex reasoning patterns.
-
Few-shot Learning for Text Style Transfer
Overview: Design a text style transfer system that can quickly adapt to new styles or domains with limited examples, using few-shot learning techniques to generate style-specific text.
-
Unsupervised Cross-lingual Topic Modeling
Overview: Develop a topic modeling approach that can discover and align topics across multiple languages without parallel corpora, enabling cross-lingual content analysis and organization.
-
Multimodal Hate Speech Detection in Online Communities
Overview: Implement a hate speech detection system that combines text, image, and user behavior analysis to identify and mitigate hate speech in diverse online community contexts.
-
Controllable Abstractive Summarization with Length Constraints
Overview: Create an abstractive summarization system that can generate summaries of specified lengths while maintaining coherence and capturing key information from the source text.
-
Cross-lingual Transfer Learning for Morphological Analysis
Overview: Design a morphological analysis system that can transfer knowledge from high-resource languages to improve performance on low-resource languages with complex morphological structures.
-
Adversarial Attack Detection in Text Classification Systems
Overview: Develop methods for detecting adversarial attacks on text classification models, enhancing the security and reliability of NLP systems in potentially hostile environments.
-
Neural Readability Assessment with Multi-task Learning
Overview: Implement a readability assessment model that uses multi-task learning to simultaneously predict multiple readability metrics, providing comprehensive text complexity analysis.
-
Multilingual Stance Detection in Social Media Debates
Overview: Create a stance detection system that can identify and classify stance expressions in social media debates across multiple languages, enabling cross-cultural analysis of online discussions.
-
Graph-based Dialogue State Tracking for Task-oriented Systems
Overview: Develop a dialogue state tracking method using graph-based representations to more effectively capture and update complex states in task-oriented dialogue systems.
-
Few-shot Learning for Cross-domain Text Classification
Overview: Design a text classification model that can quickly adapt to new domains with limited labeled data, using few-shot learning techniques to transfer knowledge across diverse topics.
-
Unsupervised Text Segmentation with Neural Language Models
Overview: Implement an unsupervised approach to text segmentation using neural language models, automatically identifying meaningful segments or topics within long documents.
-
Multimodal Emotion Cause Detection in Text and Images
Overview: Create a system that can identify the causes of emotions in multimodal content, combining text analysis and image understanding to provide deeper insights into emotional expressions.
-
Controllable Neural Story Generation with Plot Outlines
Overview: Develop a story generation system that can produce coherent narratives based on given plot outlines, allowing for controllable and structured creative writing assistance.
-
Cross-lingual Semantic Textual Similarity with Minimal Supervision
Overview: Implement a semantic textual similarity model that can work across languages with minimal supervision, enabling cross-lingual document comparison and information retrieval.
Computer Vision Projects
-
Few-shot Object Detection in Satellite Imagery
Overview: Develop an object detection system for satellite images that can identify new object classes with very few labeled examples, useful for rapid disaster response or environmental monitoring.
Resources:
- Paper: "Few-Shot Object Detection on Remote Sensing Images" (Deng et al., 2020)
- Paper: "Meta-DETR: Few-Shot Object Detection via Unified Image-Level Meta-Learning" (Zhang et al., 2021)
- Dataset: xView Dataset for Object Detection in Overhead Imagery
-
Multimodal Visual Question Answering with Knowledge Graphs
Overview: Create a system that combines image understanding with knowledge graph reasoning to answer complex questions about visual content, bridging visual and semantic information.
Resources:
- Paper: "MUTAN: Multimodal Tucker Fusion for Visual Question Answering" (Ben-Younes et al., 2017)
- Paper: "FVQA: Fact-based Visual Question Answering" (Wang et al., 2018)
- Dataset: Visual Genome Dataset
-
Unsupervised Domain Adaptation for Semantic Segmentation
Overview: Design a semantic segmentation model that can adapt to new visual domains (e.g., different cities or weather conditions) without requiring labeled data from the target domain.
Resources:
- Paper: "Unsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-Training" (Zou et al., 2018)
- Paper: "ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation" (Vu et al., 2019)
- Dataset: Cityscapes Dataset
-
3D Human Pose Estimation from Monocular Video
Overview: Develop a model that can accurately estimate 3D human poses from single-camera video input, useful for motion capture, sports analysis, or augmented reality applications.
Resources:
- Paper: "3D Human Pose Estimation in Video with Temporal Convolutions and Semi-Supervised Training" (Pavllo et al., 2019)
- Paper: "VIBE: Video Inference for Human Body Pose and Shape Estimation" (Kocabas et al., 2020)
- Dataset: Human3.6M Dataset
-
Adversarial Defense Mechanisms for Robust Image Classification
Overview: Create defensive techniques to protect image classification models against adversarial attacks, improving their reliability and security in real-world deployment scenarios.
Resources:
- Paper: "Towards Deep Learning Models Resistant to Adversarial Attacks" (Madry et al., 2018)
- Paper: "Feature Denoising for Improving Adversarial Robustness" (Xie et al., 2019)
- Dataset: ImageNet-A (Adversarial Examples Dataset)
-
Neural Architecture Search for Efficient Object Detection
Overview: Implement an automated system to discover optimal neural network architectures for object detection tasks, balancing accuracy and computational efficiency for various hardware constraints.
Resources:
- Paper: "NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection" (Ghiasi et al., 2019)
- Paper: "EfficientDet: Scalable and Efficient Object Detection" (Tan et al., 2020)
- Dataset: COCO Dataset
-
Self-supervised Learning for Medical Image Analysis
Overview: Develop a self-supervised learning approach for medical image analysis tasks, reducing the need for large amounts of labeled medical data while improving diagnostic capabilities.
Resources:
- Paper: "Self-supervised Learning in Medical Image Analysis" (Zhou et al., 2021)
- Paper: "Contrastive Learning of Medical Visual Representations from Paired Images and Text" (Zhang et al., 2020)
- Dataset: MIMIC-CXR Dataset
-
Graph Convolutional Networks for 3D Shape Analysis
Overview: Create a model using graph convolutional networks to analyze and classify 3D shapes, useful for computer-aided design, 3D printing applications, or object recognition in point cloud data.
Resources:
- Paper: "Dynamic Graph CNN for Learning on Point Clouds" (Wang et al., 2019)
- Paper: "MeshCNN: A Network with an Edge" (Hanocka et al., 2019)
- Dataset: ShapeNet Dataset
-
Weakly Supervised Instance Segmentation in Videos
Overview: Design an instance segmentation system for videos that can learn from weak labels (e.g., bounding boxes or image-level labels) rather than pixel-level annotations, reducing annotation costs.
Resources:
- Paper: "Weakly Supervised Instance Segmentation using Class Peak Response" (Zhou et al., 2018)
- Paper: "Learning to Segment Every Thing" (Hu et al., 2018)
- Dataset: YouTube-VOS Dataset
-
Generative Adversarial Networks for Image-to-Image Translation
Overview: Implement a GAN-based system for translating images between different domains (e.g., day to night, summer to winter) while preserving content and structure, useful for content creation and data augmentation.
Resources:
- Paper: "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks" (Zhu et al., 2017)
- Paper: "UNIT: Unsupervised Image-to-Image Translation Networks" (Liu et al., 2017)
- Dataset: Cityscapes Dataset
-
Visual Commonsense Reasoning in Dynamic Scenes
Overview: Develop a model that can understand and reason about dynamic visual scenes, inferring causal relationships and predicting future states based on visual common sense knowledge.
Resources:
- Paper: "Visual Commonsense R-CNN" (Wang et al., 2020)
- Paper: "CLEVRER: CoLlision Events for Video REpresentation and Reasoning" (Yi et al., 2020)
- Dataset: CLEVR-er Dataset
-
Continuous Learning for Visual Object Tracking
Overview: Create an object tracking system that can continuously learn and adapt to new object appearances and environments without forgetting previously learned information.
Resources:
- Paper: "Learning to Update Model-Agnostic Visual Tracking Systems" (Li et al., 2020)
- Paper: "Learning Dynamic Memory Networks for Object Tracking" (Yang et al., 2018)
- Dataset: LaSOT (Large-scale Single Object Tracking) Dataset
-
Depth Estimation from Single Images with Uncertainty
Overview: Design a depth estimation model that can predict depth maps from single images while also providing uncertainty estimates, useful for robust 3D reconstruction and autonomous navigation.
Resources:
- Paper: "Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Cameras" (Gordon et al., 2019)
- Paper: "PackNet-SfM: 3D Packing for Self-Supervised Monocular Depth Estimation" (Guizilini et al., 2020)
- Dataset: KITTI Dataset
-
Cross-modal Retrieval between Images and Text
Overview: Implement a retrieval system that can match images with relevant textual descriptions and vice versa, enabling advanced search capabilities in multimedia databases.
Resources:
- Paper: "VSE++: Improving Visual-Semantic Embeddings with Hard Negatives" (Faghri et al., 2018)
- Paper: "CLIP: Learning Transferable Visual Models From Natural Language Supervision" (Radford et al., 2021)
- Dataset: MS-COCO Dataset
-
Explainable AI for Medical Diagnosis from Radiographs
Overview: Develop an interpretable AI system for diagnosing medical conditions from radiographs, providing explanations for its decisions to aid healthcare professionals in diagnosis and treatment planning.
Resources:
- Paper: "CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison" (Irvin et al., 2019)
- Paper: "Interpretable and Accurate Fine-grained Recognition via Region Grouping" (Huang et al., 2020)
- Dataset: CheXpert Dataset
-
Few-shot Learning for Fine-grained Visual Recognition
Overview: Create a fine-grained visual recognition system that can quickly learn to distinguish between closely related object categories (e.g., bird species) with only a few labeled examples per class.
Resources:
- Paper: "Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learning" (Chen et al., 2021)
- Paper: "DeepEMD: Few-Shot Image Classification with Differentiable Earth Mover's Distance and Structured Classifiers" (Zhang et al., 2020)
- Dataset: CUB-200-2011 Dataset
-
Adversarial Examples for Testing Robustness of Autonomous Vehicles
Overview: Generate adversarial examples to test and improve the robustness of computer vision systems used in autonomous vehicles, ensuring safety and reliability in diverse driving conditions.
Resources:
- Paper: "Robust Physical-World Attacks on Deep Learning Visual Classification" (Eykholt et al., 2018)
- Paper: "Towards Evaluating the Robustness of Neural Networks" (Carlini & Wagner, 2017)
- Dataset: Berkeley DeepDrive Dataset
-
Neural Style Transfer for Video Sequences
Overview: Extend neural style transfer techniques to video sequences, maintaining temporal consistency while applying artistic styles to moving images for creative video editing applications.
Resources:
- Paper: "Real-Time Neural Style Transfer for Videos" (Huang et al., 2017)
- Paper: "ReReVST: Efficient Reversible Video Style Transfer" (Guo et al., 2021)
- Dataset: Hollywood2 Dataset
-
Multimodal Emotion Recognition in the Wild
Overview: Develop a system that combines facial expressions, body language, voice, and context to recognize emotions in unconstrained "in-the-wild" settings, useful for human-computer interaction and affective computing.
Resources:
- Paper: "EmotiCon: Context-Aware Multimodal Emotion Recognition in Conversation" (Ghosal et al., 2020)
- Paper: "M3ER: Multiplicative Multimodal Emotion Recognition using Facial, Textual, and Speech Cues" (Mittal et al., 2020)
- Dataset: IEMOCAP Dataset
-
Unsupervised Learning of Optical Flow with Geometric Constraints
Overview: Create an unsupervised learning approach for estimating optical flow in videos, incorporating geometric constraints to improve accuracy without relying on labeled training data.
Resources:
- Paper: "UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss" (Meister et al., 2018)
- Paper: "SelFlow: Self-Supervised Learning of Optical Flow" (Liu et al., 2019)
- Dataset: MPI Sintel Flow Dataset
-
Graph-based Few-shot Learning for Image Classification
Overview: Implement a few-shot learning system for image classification that uses graph neural networks to capture relationships between support and query images, improving generalization to new classes.
Resources:
- Paper: "Edge-Labeling Graph Neural Network for Few-shot Learning" (Kim et al., 2019)
- Paper: "Few-Shot Learning with Graph Neural Networks" (Garcia & Bruna, 2018)
- Dataset: Mini-ImageNet Dataset
-
Robust Visual SLAM for Dynamic Environments
Overview: Design a visual Simultaneous Localization and Mapping (SLAM) system that can operate reliably in dynamic environments with moving objects, useful for robotics and augmented reality applications.
Resources:
- Paper: "DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes" (Bescos et al., 2018)
- Paper: "MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objects" (Runz et al., 2018)
- Dataset: TUM RGB-D SLAM Dataset
-
Self-supervised Depth and Ego-motion Estimation
Overview: Develop a self-supervised learning approach for jointly estimating depth maps and camera ego-motion from monocular video sequences, enabling 3D understanding without explicit depth supervision.
Resources:
- Paper: "Unsupervised Learning of Depth and Ego-Motion from Video" (Zhou et al., 2017)
- Paper: "Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Cameras" (Gordon et al., 2019)
- Dataset: KITTI Odometry Dataset
-
Cross-view Image Synthesis for Geo-localization
Overview: Create a system that can synthesize ground-level views from aerial images (or vice versa) to aid in geo-localization tasks, bridging the gap between different viewpoints in location recognition.
Resources:
- Paper: "CrossView: Cross-View Image Synthesis for Geo-localization" (Regmi & Shah, 2019)
- Paper: "Where and What? Examining Interpretable Disentangled Representations for Fine-Grained Cross-View Image Geo-Localization" (Shi et al., 2020)
- Dataset: CVUSA Dataset
-
Adversarial Training for Domain Generalization in Medical Imaging
Overview: Implement adversarial training techniques to improve the generalization of medical imaging models across different scanners, protocols, or patient populations, enhancing robustness in clinical deployment.
Resources:
- Paper: "Generalizing to Unseen Domains via Adversarial Data Augmentation" (Volpi et al., 2018)
- Paper: "Domain Generalization via Model-Agnostic Learning of Semantic Features" (Dou et al., 2019)
- Dataset: Medical Segmentation Decathlon Dataset
-
Neural Radiance Fields (NeRF) for Novel View Synthesis
Overview: Extend and optimize Neural Radiance Fields for efficient novel view synthesis of complex scenes, enabling applications in virtual reality, cinematography, and 3D content creation.
Resources:
- Paper: "NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis" (Mildenhall et al., 2020)
- Paper: "NeRF++: Analyzing and Improving Neural Radiance Fields" (Zhang et al., 2020)
- Dataset: LLFF (Local Light Field Fusion) Dataset
-
Continual Learning for Object Detection in Streaming Data
Overview: Develop an object detection system that can continuously learn and adapt to new object classes and appearances in streaming video data without catastrophic forgetting of previously learned knowledge.
Resources:
- Paper: "Incremental Learning of Object Detectors without Catastrophic Forgetting" (Shmelkov et al., 2017)
- Paper: "Learning to Adapt Object Detectors via Selective Cross-Domain Alignment" (Wang et al., 2019)
- Dataset: Stream-51 Dataset
-
Multimodal Person Re-identification in Surveillance Videos
Overview: Create a person re-identification system that combines visual appearance, gait analysis, and contextual information to accurately track individuals across multiple cameras in surveillance networks.
Resources:
- Paper: "Multi-Modal Uniform Deep Learning for RGB-D Person Re-Identification" (Wu et al., 2017)
- Paper: "Beyond Intra-modality: A Survey of Heterogeneous Person Re-identification" (Leng et al., 2019)
- Dataset: MARS (Motion Analysis and Re-identification Set) Dataset
-
Weakly Supervised Semantic Segmentation with Point Annotations
Overview: Design a semantic segmentation model that can learn from sparse point annotations rather than full pixel-wise labels, reducing the annotation effort required for large-scale segmentation tasks.
Resources:
- Paper: "What's the Point: Semantic Segmentation with Point Supervision" (Bearman et al., 2016)
- Paper: "Learning to Segment Every Thing" (Hu et al., 2018)
- Dataset: PASCAL VOC 2012 Dataset
-
Generative Models for 3D Shape Completion and Reconstruction
Overview: Implement generative models capable of completing partial 3D shapes and reconstructing full 3D models from limited input (e.g., single views or sparse point clouds), useful for 3D scanning and modeling applications.
Resources:
- Paper: "Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling" (Wu et al., 2016)
- Paper: "AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation" (Groueix et al., 2018)
- Dataset: ShapeNet Dataset
-
Visual Relationship Detection with Scene Graph Generation
Overview: Develop a system that can detect and classify relationships between objects in images, generating scene graphs that capture the semantic structure of visual scenes for improved scene understanding.
Resources:
- Paper: "Scene Graph Generation by Iterative Message Passing" (Xu et al., 2017)
- Paper: "Neural Motifs: Scene Graph Parsing with Global Context" (Zellers et al., 2018)
- Dataset: Visual Genome Dataset
-
Self-supervised Learning for Video Representation
Overview: Create self-supervised learning techniques for learning rich video representations without manual annotations, leveraging temporal coherence and multi-modal information in video data.
Resources:
- Paper: "Self-Supervised Video Representation Learning With Odd-One-Out Networks" (Fernando et al., 2017)
- Paper: "Video Representation Learning by Dense Predictive Coding" (Han et al., 2019)
- Dataset: Kinetics-400 Dataset
-
Depth-aware Instance Segmentation in RGB-D Images
Overview: Design an instance segmentation model that effectively utilizes both color and depth information from RGB-D sensors to improve segmentation accuracy in 3D environments.
Resources:
- Paper: "RGBD-Net: Predicting Color and Depth Images for Novel Views Synthesis" (Liu et al., 2018)
- Paper: "3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans" (Hou et al., 2019)
- Dataset: ScanNet Dataset
-
Cross-domain Few-shot Learning for Fine-grained Recognition
Overview: Implement a few-shot learning system that can adapt fine-grained recognition models (e.g., for species identification) across different domains with limited labeled examples in the target domain.
Resources:
- Paper: "Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation" (Tseng et al., 2020)
- Paper: "Boosting Few-Shot Learning With Adaptive Margin Loss" (Niu et al., 2020)
- Dataset: CUB-200-2011 and NABirds Datasets
-
Explainable 3D Object Detection for Autonomous Driving
Overview: Develop an interpretable 3D object detection system for autonomous driving that can provide explanations for its detections, improving trust and enabling better integration with decision-making systems.
Resources:
- Paper: "Explainable Object Detection With Salient Image Regions" (Petsiuk et al., 2020)
- Paper: "Interpretable and Globally Optimal Prediction for Textual Grounding using Image Concepts" (Yeh et al., 2017)
- Dataset: nuScenes Dataset
-
Graph Neural Networks for Social Relationship Recognition
Overview: Create a model using graph neural networks to recognize and classify social relationships between individuals in images or videos, considering both visual cues and spatial-temporal context.
Resources:
- Paper: "Dual-Glance Model for Deciphering Social Relationships" (Li et al., 2017)
- Paper: "Group Activity Recognition via Attentive Temporal Fields" (Ibrahim et al., 2018)
- Dataset: PISC (People in Social Context) Dataset
-
Adversarial Patch Generation for Physical-world Attacks
Overview: Research and implement methods for generating adversarial patches that can fool computer vision systems when applied in the physical world, highlighting potential vulnerabilities in real-world AI applications.
Resources:
- Paper: "Adversarial Patch" (Brown et al., 2017)
- Paper: "ShapeShifter: Robust Physical Adversarial Attack on Faster R-CNN Object Detector" (Chen et al., 2019)
- Dataset: MS-COCO Dataset
-
Neural Architecture Search for Efficient Semantic Segmentation
Overview: Develop an automated system to discover optimal neural network architectures for semantic segmentation tasks, balancing accuracy and computational efficiency for deployment on various devices.
Resources:
- Paper: "Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation" (Liu et al., 2019)
- Paper: "NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection" (Ghiasi et al., 2019)
- Dataset: Cityscapes Dataset
-
Multimodal Fusion for Action Recognition in Untrimmed Videos
Overview: Design an action recognition system that effectively fuses information from multiple modalities (e.g., RGB, optical flow, audio) to classify actions in long, untrimmed videos with complex scenes.
Resources:
- Paper: "SlowFast Networks for Video Recognition" (Feichtenhofer et al., 2019)
- Paper: "Long-Term Feature Banks for Detailed Video Understanding" (Wu et al., 2019)
- Dataset: ActivityNet Dataset
-
Unsupervised Domain Adaptation for Nighttime Semantic Segmentation
Overview: Create a semantic segmentation model that can adapt from daytime to nighttime imagery without requiring labeled nighttime data, addressing the domain shift caused by challenging lighting conditions.
Resources:
- Paper: "DANNet: A One-Stage Domain Adaptation Network for Unsupervised Nighttime Semantic Segmentation" (Wu et al., 2021)
- Paper: "Guided Curriculum Model Adaptation and Uncertainty-Aware Evaluation for Semantic Nighttime Image Segmentation" (Sakaridis et al., 2019)
- Dataset: Dark Zurich Dataset
-
Few-shot Learning for Abnormal Event Detection in Surveillance
Overview: Implement a few-shot learning approach for detecting abnormal events in surveillance video streams, allowing the system to quickly adapt to new types of anomalies with minimal labeled examples.
Resources:
- Paper: "Few-Shot Scene-Adaptive Anomaly Detection" (Tan et al., 2021)
- Paper: "Learning Memory-Guided Normality for Anomaly Detection" (Park et al., 2020)
- Dataset: UCF-Crime Dataset
-
Robust Visual Localization in Changing Environments
Overview: Develop a visual localization system that can accurately determine camera pose in environments that undergo significant changes over time (e.g., different seasons, weather conditions, or structural modifications).
Resources:
- Paper: "From Coarse to Fine: Robust Hierarchical Localization at Large Scale" (Sarlin et al., 2019)
- Paper: "Visual Localization Under Appearance Change: A Filtering Approach" (Stenborg et al., 2018)
- Dataset: RobotCar Seasons Dataset
-
Self-supervised Learning for Dense Visual Odometry
Overview: Create a self-supervised learning approach for estimating dense visual odometry from monocular or stereo video sequences, enabling accurate camera motion estimation without relying on labeled training data.
Resources:
- Paper: "Self-Supervised Deep Visual Odometry with Online Adaptation" (Zhan et al., 2020)
- Paper: "D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry" (Yang et al., 2020)
- Dataset: KITTI Odometry Dataset
-
Cross-view Action Recognition with View Synthesis
Overview: Design an action recognition system that can recognize actions across different viewpoints by synthesizing novel views, improving robustness to viewpoint variations in multi-camera setups.
Resources:
- Paper: "View-Invariant Probabilistic Embedding for Human Pose" (Zhang et al., 2020)
- Paper: "Learning Cross-View Action Recognition from Temporal Self-Similarities" (Junejo et al., 2011)
- Dataset: NTU RGB+D Dataset
-
Adversarial Training for Robust Facial Expression Recognition
Overview: Implement adversarial training techniques to improve the robustness of facial expression recognition models against variations in pose, lighting, and occlusions, enhancing performance in real-world scenarios.
Resources:
- Paper: "Adversarial Training for Multi-Channel Sign Language Recognition" (Niu et al., 2020)
- Paper: "Facial Expression Recognition via Adversarial Learning" (Wang et al., 2020)
- Dataset: AffectNet Dataset
-
Neural Implicit Representations for 3D Scene Reconstruction
Overview: Develop neural implicit representation techniques for reconstructing complex 3D scenes from multiple views, enabling high-quality 3D modeling with compact and continuous representations.
Resources:
- Paper: "Implicit Neural Representations with Periodic Activation Functions" (Sitzmann et al., 2020)
- Paper: "MetaSDF: Meta-learning Signed Distance Functions" (Sitzmann et al., 2020)
- Dataset: Tanks and Temples Dataset
-
Continual Learning for Visual Question Answering
Overview: Create a visual question answering system that can continuously learn and adapt to new types of questions and visual concepts without forgetting previously learned knowledge.
Resources:
- Paper: "Continual Learning for Visual Question Answering" (Zhang et al., 2020)
- Paper: "Dynamic Memory Networks for Visual and Textual Question Answering" (Xiong et al., 2016)
- Dataset: VQA v2.0 Dataset
-
Multimodal Saliency Detection in 360-degree Videos
Overview: Design a saliency detection model for 360-degree videos that combines visual, audio, and motion cues to predict viewer attention in immersive video content, useful for VR/AR applications.
Resources:
- Paper: "SalNet360: Saliency Maps for Omni-Directional Images with CNN" (Monroy et al., 2018)
- Paper: "Saliency Detection in 360° Videos" (Cheng et al., 2018)
- Dataset: 360-VSOD Dataset
-
Weakly Supervised Object Localization with Class Activation Maps
Overview: Implement a weakly supervised object localization technique using class activation maps, enabling object detection and localization with only image-level labels instead of bounding box annotations.
Resources:
- Paper: "Learning Deep Features for Discriminative Localization" (Zhou et al., 2016)
- Paper: "Self-produced Guidance for Weakly-supervised Object Localization" (Zhang et al., 2018)
- Dataset: ILSVRC Dataset
-
Generative Models for Controllable Image Manipulation
Overview: Develop generative models that allow for fine-grained control over image manipulation tasks, such as changing specific attributes or style transfer, while preserving image realism and identity.
Resources:
- Paper: "StyleGAN2: Analyzing and Improving the Image Quality of StyleGAN" (Karras et al., 2020)
- Paper: "Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation" (Richardson et al., 2021)
- Dataset: FFHQ (Flickr-Faces-HQ) Dataset
-
Few-shot Learning for Medical Image Segmentation
Overview: Create a few-shot learning approach for medical image segmentation that can quickly adapt to new anatomical structures or pathologies with limited labeled examples, reducing the annotation burden in medical imaging.
Resources:
- Paper: "Few-Shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning" (Zhao et al., 2019)
- Paper: "Data-Efficient Learning for 3D Medical Image Segmentation" (Ouyang et al., 2020)
-
Multimodal Biometric Recognition (Face, Iris, Fingerprint)
Overview: Implement a multimodal biometric recognition system that combines face, iris, and fingerprint information for robust and accurate person identification in high-security applications.
Resources:
- Paper: "Multi-modal Biometrics: An Overview" (Ross & Jain, 2004)
- Paper: "Deep Learning for Biometric Recognition: A Survey" (Sundararajan & Woodard, 2018)
-
Unsupervised Anomaly Detection in Industrial Visual Inspection
Overview: Develop an unsupervised anomaly detection system for industrial visual inspection tasks, capable of identifying defects or anomalies in manufacturing processes without requiring labeled defect data.
Resources:
- Paper: "A Survey of Deep Learning-based Anomaly Detection in Visual Inspection" (Bergmann et al., 2021)
- Paper: "Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery" (Schlegl et al., 2017)
-
3D Object Detection from Point Clouds for Autonomous Driving
Overview: Design a 3D object detection system that can accurately localize and classify objects in LiDAR point cloud data for autonomous driving applications, handling challenges such as sparsity and occlusion.
Resources:
- Paper: "VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection" (Zhou & Tuzel, 2018)
- Paper: "PointPillars: Fast Encoders for Object Detection from Point Clouds" (Lang et al., 2019)
-
Adversarial Training for Robust Depth Estimation
Overview: Implement adversarial training techniques to improve the robustness of monocular depth estimation models against domain shifts and challenging environmental conditions.
Resources:
- Paper: "Robust Adversarial Learning for Depth Estimation" (Ji et al., 2019)
- Paper: "Domain Adversarial Neural Networks for Domain Generalization: When It Works and How to Improve" (Matsuura & Harada, 2020)
-
Neural Rendering for Virtual Try-on Applications
Overview: Create a neural rendering system for virtual try-on applications, allowing users to realistically visualize clothing items on their own body or a customized avatar.
Resources:
- Paper: "VITON: An Image-based Virtual Try-on Network" (Han et al., 2018)
- Paper: "Towards Multi-pose Guided Virtual Try-on Network" (Yang et al., 2020)
-
Self-supervised Learning for Video Inpainting
Overview: Develop a self-supervised learning approach for video inpainting, enabling the removal of objects or restoration of damaged regions in video sequences without requiring paired training data.
Resources:
- Paper: "Copy-and-Paste Networks for Deep Video Inpainting" (Lee et al., 2019)
- Paper: "Learning Video Inpainting without Training Videos" (Zhang et al., 2020)
-
Graph-based Few-shot Learning for Action Recognition
Overview: Implement a few-shot learning framework using graph neural networks to recognize new action classes in videos with only a few labeled examples, leveraging relationships between action classes.
Resources:
- Paper: "Few-shot Action Recognition with Permutation-invariant Attention" (Zhang et al., 2020)
- Paper: "Graph Convolutional Networks for Temporal Action Localization" (Zeng et al., 2019)
-
Robust Multi-object Tracking in Crowded Scenes
Overview: Design a multi-object tracking system that can handle occlusions, identity switches, and complex interactions in crowded environments, useful for surveillance and crowd analysis applications.
Resources:
- Paper: "Simple Online and Realtime Tracking with a Deep Association Metric" (Wojke et al., 2017)
- Paper: "FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking" (Zhang et al., 2021)
-
Depth-aware Image Matting and Compositing
Overview: Create an image matting and compositing system that utilizes depth information to improve the accuracy of foreground extraction and realistic blending in augmented reality applications.
Resources:
- Paper: "Deep Image Matting" (Xu et al., 2017)
- Paper: "Depth-Aware Image Compositing" (Wadhwa et al., 2018)
-
Cross-domain Adaptation for Semantic Segmentation in Aerial Imagery
Overview: Develop domain adaptation techniques for semantic segmentation models to generalize across different types of aerial imagery (e.g., satellite, drone, or aircraft-based), accounting for variations in resolution, perspective, and imaging conditions.
Resources:
- Paper: "Domain Adaptation for Semantic Segmentation via Class-Balanced Self-Training" (Zou et al., 2018)
- Paper: "Learning to Adapt Structured Output Space for Semantic Segmentation" (Tsai et al., 2018)
-
Explainable Visual Reasoning for Robotic Manipulation
Overview: Implement an explainable AI system for visual reasoning in robotic manipulation tasks, providing interpretable decision-making processes for grasping, object manipulation, and task planning.
Resources:
- Paper: "Explainable Reinforcement Learning for Robotic Manipulation" (Sreedharan et al., 2020)
- Paper: "Visual Explanations from Deep Networks via Gradient-based Localization" (Selvaraju et al., 2017)
-
Generative Models for Realistic Synthetic Data Generation
Overview: Create advanced generative models capable of producing highly realistic synthetic image and video data for training computer vision models, reducing the need for large-scale real-world data collection.
Resources:
- Paper: "Generating Diverse High-Fidelity Images with VQ-VAE-2" (Razavi et al., 2019)
- Paper: "A Style-Based Generator Architecture for Generative Adversarial Networks" (Karras et al., 2019)
-
Neural Super-resolution for Medical Imaging
Overview: Design a neural super-resolution system specifically tailored for medical imaging modalities, enhancing the resolution and quality of medical images to aid in diagnosis and treatment planning.
Resources:
- Paper: "Deep Learning for Single Image Super-Resolution: A Brief Review" (Yang et al., 2019)
- Paper: "Efficient and Accurate MRI Super-Resolution using a Generative Adversarial Network and 3D Multi-Level Densely Connected Network" (Chen et al., 2018)
-
Multimodal Emotion Recognition in Human-Robot Interaction
Overview: Develop a multimodal emotion recognition system that combines visual, audio, and contextual cues to understand human emotions during human-robot interactions, enabling more natural and empathetic robotic responses.
Resources:
- Paper: "A Survey of Multimodal Sentiment Analysis" (Poria et al., 2017)
- Paper: "EmotiCon: Context-Aware Multimodal Emotion Recognition in Conversation" (Majumder et al., 2020)
-
Unsupervised Learning of Visual Representations from Video
Overview: Create an unsupervised learning approach for extracting rich visual representations from unlabeled video data, leveraging temporal coherence and motion information to learn meaningful features.
Resources:
- Paper: "Self-Supervised Learning of Video-Induced Visual Invariances" (Wang et al., 2019)
- Paper: "Time-Contrastive Networks: Self-Supervised Learning from Video" (Sermanet et al., 2018)
-
Few-shot Learning for 3D Object Recognition from Multiple Views
Overview: Implement a few-shot learning system for recognizing 3D objects from multiple 2D views, enabling quick adaptation to new object classes with limited training examples.
Resources:
- Paper: "Multi-View Few-Shot Learning for 3D Point Cloud Classification" (Liu et al., 2019)
- Paper: "Few-Shot Learning with Geometric Constraints" (Kang et al., 2019)
-
Adversarial Training for Robust Visual Odometry
Overview: Develop adversarial training techniques to improve the robustness of visual odometry systems against challenging conditions such as motion blur, lighting changes, and dynamic objects.
Resources:
- Paper: "Adversarial Training for Visual Odometry" (Zhou et al., 2020)
- Paper: "Unsupervised Deep Visual Odometry with Online Adaptation" (Wang et al., 2020)
-
Graph Neural Networks for 3D Point Cloud Segmentation
Overview: Design a graph neural network-based approach for segmenting 3D point cloud data, effectively handling irregular point distributions and capturing complex geometric relationships.
Resources:
- Paper: "Dynamic Graph CNN for Learning on Point Clouds" (Wang et al., 2019)
- Paper: "PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space" (Qi et al., 2017)
-
Self-supervised Learning for Depth Completion in LiDAR Data
Overview: Create a self-supervised learning method for completing sparse LiDAR depth maps, utilizing geometric constraints and multi-view consistency to generate dense and accurate depth information.
Resources:
- Paper: "Self-supervised Sparse-to-Dense: Self-supervised Depth Completion from LiDAR and Monocular Camera" (Ma et al., 2019)
- Paper: "Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints" (Xu et al., 2019)
-
Cross-modal Retrieval between 3D Models and Natural Language
Overview: Implement a cross-modal retrieval system that can match 3D models with natural language descriptions and vice versa, enabling advanced search capabilities in 3D model databases.
Resources:
- Paper: "Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings" (Chen et al., 2018)
- Paper: "3D-Aware Scene Retrieval via Text" (Gu et al., 2020)
-
Explainable AI for Fashion Recommendation Systems
Overview: Develop an interpretable AI system for fashion recommendation that can explain its suggestions based on visual features, style preferences, and current trends.
Resources:
- Paper: "Personalized Fashion Recommendation with Visual Explanations based on Multimodal Attention Network" (Chen et al., 2019)
- Paper: "Interpretable Fashion Matching with Rich Attributes" (Han et al., 2017)
-
Generative Models for 3D Human Motion Synthesis
Overview: Create generative models capable of synthesizing realistic 3D human motions, useful for animation, motion prediction in sports analysis, and human-computer interaction applications.
Resources:
- Paper: "On Human Motion Prediction Using Recurrent Neural Networks" (Martinez et al., 2017)
- Paper: "A Robust and Precise Motion Prediction Framework for Real Human Motion" (Mao et al., 2019)
-
Neural Architecture Search for Efficient Image Super-resolution
Overview: Implement an automated system to discover optimal neural network architectures for image super-resolution tasks, balancing quality improvements with computational efficiency.
Resources:
- Paper: "ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks" (Wang et al., 2018)
- Paper: "Neural Architecture Search for Image Super-Resolution" (Chu et al., 2020)
-
Multimodal Fusion for Autonomous Driving Perception
Overview: Design a perception system for autonomous driving that effectively fuses information from multiple sensors (e.g., cameras, LiDAR, radar) to achieve robust and accurate environmental understanding.
Resources:
- Paper: "Multi-Task Multi-Sensor Fusion for 3D Object Detection" (Liang et al., 2019)
- Paper: "Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving" (Chen et al., 2017)
-
Unsupervised Domain Adaptation for Face Recognition
Overview: Develop unsupervised domain adaptation techniques to improve the performance of face recognition models across different domains (e.g., varying ethnicities, age groups, or imaging conditions) without requiring labeled target domain data.
Resources:
- Paper: "Unsupervised Domain Adaptation for Face Recognition in Unlabeled Videos" (Sohn et al., 2017)
- Paper: "Unsupervised Open Domain Recognition by Semantic Discrepancy Minimization" (Xu et al., 2019)
-
Few-shot Learning for Hand Pose Estimation in Egocentric Videos
Overview: Create a few-shot learning approach for estimating hand poses in egocentric video streams, enabling quick adaptation to new hand shapes, sizes, and interaction scenarios with minimal labeled data.
Resources:
- Paper: "Few-Shot Adaptive Faster R-CNN" (Wang et al., 2019)
- Paper: "Egocentric Hand Pose Estimation Using Deformation and Orientation Aware Cascaded Regression" (Zhu et al., 2019)
-
Adversarial Training for Robust Visual Place Recognition
Overview: Implement adversarial training techniques to enhance the robustness of visual place recognition systems against variations in lighting, weather, and seasonal changes.
Resources:
- Paper: "Deep Visual Geo-Localization Benchmark" (Warburg et al., 2020)
- Paper: "NetVLAD: CNN Architecture for Weakly Supervised Place Recognition" (Arandjelovic et al., 2016)
-
Graph-based Reasoning for Visual Commonsense Tasks
Overview: Develop a graph-based reasoning framework for solving visual commonsense tasks, such as predicting future states or inferring causal relationships in complex visual scenes.
Resources:
- Paper: "Compositional Learning for Human Object Interaction" (Li et al., 2020)
- Paper: "Visual Commonsense R-CNN" (Wang et al., 2020)
-
Self-supervised Learning for Monocular Depth Estimation
Overview: Create a self-supervised learning approach for estimating depth from single images without requiring ground truth depth data, leveraging geometric constraints and multi-view consistency.
Resources:
- Paper: "Digging Into Self-Supervised Monocular Depth Estimation" (Godard et al., 2019)
- Paper: "Self-Supervised Learning of Depth and Ego-Motion from Video" (Zhou et al., 2017)
-
Cross-view Geo-localization with Satellite and Street-level Imagery
Overview: Design a geo-localization system that can match street-level images with satellite imagery (or vice versa) to determine location, useful for navigation and augmented reality applications.
Resources:
- Paper: "Where Am I Looking At? Joint Location and Orientation Estimation by Cross-View Matching" (Shi et al., 2020)
- Paper: "Spatial Semantic Alignment for Cross-View Image Geo-Localization" (Tian et al., 2019)
-
Explainable AI for Automated Video Surveillance
Overview: Implement an interpretable AI system for video surveillance that can detect and explain anomalous events, providing transparent reasoning for security decision-making.
Resources:
- Paper: "Explainable Deep Learning for Video Surveillance: A Comprehensive Survey" (Islam et al., 2021)
- Paper: "Explaining Deep Neural Networks for Knowledge Discovery in Electrocardiogram Analysis" (Tjoa et al., 2020)
-
Generative Models for Synthetic Medical Image Generation
Overview: Develop advanced generative models for creating realistic synthetic medical images across various modalities, useful for data augmentation and privacy-preserving medical research.
Resources:
- Paper: "Medical Image Synthesis with Context-Aware Generative Adversarial Networks" (Nie et al., 2017)
- Paper: "Synthetic Medical Images from Dual Generative Adversarial Networks" (Wolterink et al., 2018)
-
Neural Rendering for Virtual Reality Applications
Overview: Create neural rendering techniques for generating high-quality, personalized content in virtual reality environments, enabling more immersive and realistic VR experiences.
Resources:
- Paper: "Neural Rendering and Reenactment of Human Actor Videos" (Liu et al., 2019)
- Paper: "DeepVoxels: Learning Persistent 3D Feature Embeddings" (Sitzmann et al., 2019)
-
Multimodal Fusion for Human Activity Recognition
Overview: Design a human activity recognition system that combines data from wearable sensors, video, and environmental context to accurately classify complex activities in real-world settings.
Resources:
- Paper: "A Survey on Deep Multimodal Learning for Computer Vision: Advances, Trends, Applications, and Datasets" (Baltrusaitis et al., 2019)
- Paper: "Deep Multimodal Fusion by Channel Exchanging" (Wang et al., 2020)
-
Unsupervised Learning of Disentangled Representations from Video
Overview: Develop an unsupervised learning approach to disentangle various factors (e.g., object properties, motion, camera viewpoint) in video representations, enabling more controllable and interpretable video analysis.
Resources:
- Paper: "Unsupervised Learning of Object Landmarks through Conditional Image Generation" (Jakab et al., 2018)
- Paper: "Disentangled Representation Learning in Cardiac Image Analysis" (Chartsias et al., 2019)
-
Few-shot Learning for Sign Language Recognition
Overview: Implement a few-shot learning system for recognizing sign language gestures, allowing quick adaptation to different sign language dialects or new gestures with minimal labeled examples.
Resources:
- Paper: "Few-Shot and Zero-Shot Learning for Sign Language Recognition" (Huang et al., 2020)
- Paper: "Cross-Modal Few-Shot Learning for Sign Language Recognition" (Li et al., 2020)
-
Adversarial Training for Robust Facial Attribute Editing
Overview: Create adversarial training techniques to improve the robustness and realism of facial attribute editing systems, ensuring consistent performance across diverse face types and imaging conditions.
Resources:
- Paper: "AttGAN: Facial Attribute Editing by Only Changing What You Want" (He et al., 2019)
- Paper: "STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing" (Liu et al., 2019)
-
Graph Neural Networks for Visual Dialog Systems
Overview: Design a visual dialog system using graph neural networks to capture and reason about relationships between objects and concepts in images, enabling more coherent and context-aware conversations.
Resources:
- Paper: "Graph-Structured Representations for Visual Question Answering" (Teney et al., 2017)
- Paper: "Visual Dialog via Progressive Inference and Cross-Attention Refinement" (Jiang et al., 2020)
-
Self-supervised Learning for 3D Reconstruction from Multiple Views
Overview: Develop a self-supervised learning approach for 3D reconstruction from multiple 2D views, eliminating the need for explicit 3D supervision and enabling learning from large-scale unconstrained image collections.
Resources:
- Paper: "Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Prediction" (Tulsiani et al., 2018)
- Paper: "Learning Single-View 3D Reconstruction with Limited Pose Supervision" (Novotny et al., 2019)
-
Cross-modal Retrieval between Sketches and 3D Models
Overview: Implement a cross-modal retrieval system that can match hand-drawn sketches with relevant 3D models and vice versa, facilitating intuitive 3D model search and retrieval.
Resources:
- Paper: "Sketch-Based 3D Shape Retrieval Using Convolutional Neural Networks" (Wang et al., 2015)
- Paper: "Cross-Modal 3D Shape Retrieval via Shape Image Network and Shape Feature Autoencoder" (Zhang et al., 2020)
-
Explainable AI for Autonomous Vehicle Decision Making
Overview: Create an interpretable AI system for autonomous vehicle decision making that can explain its actions in human-understandable terms, improving trust and facilitating human-AI collaboration in driving scenarios.
Resources:
- Paper: "Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning" (Chen et al., 2020)
- Paper: "Explainable Deep Learning for Planning and Decision-Making of Autonomous Vehicles" (Kim et al., 2019)
-
Generative Models for Realistic Avatar Creation
Overview: Develop advanced generative models for creating highly realistic and customizable 3D avatars from limited input (e.g., a single photo), useful for virtual reality, gaming, and telepresence applications.
Resources:
- Paper: "PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization" (Saito et al., 2020)
- Paper: "VIBE: Video Inference for Human Body Pose and Shape Estimation" (Kocabas et al., 2020)
-
Neural Architecture Search for Efficient Action Recognition
Overview: Implement an automated system to discover optimal neural network architectures for action recognition in videos, balancing accuracy and computational efficiency for deployment on various devices.
Resources:
- Paper: "AutoML for Efficient 3D Action Recognition" (Pérez-Rúa et al., 2019)
- Paper: "Neural Architecture Search for Action Recognition" (Peng et al., 2019)
-
Multimodal Fusion for Emotion Recognition in AR/VR Environments
Overview: Design an emotion recognition system that combines physiological signals, facial expressions, and user interactions in augmented and virtual reality environments to enhance user experience and adaptive content delivery.
Resources:
- Paper: "EmotiVR: Emotion Recognition in Immersive Virtual Reality" (Huang et al., 2020)
- Paper: "Multimodal Emotion Recognition in Response to Videos" (Mittal et al., 2020)
-
Unsupervised Domain Adaptation for 3D Object Detection
Overview: Develop unsupervised domain adaptation techniques for 3D object detection models to generalize across different types of 3D sensors (e.g., LiDAR, depth cameras) or environments without requiring labeled target domain data.
Resources:
- Paper: "Domain Adaptation for 3D Object Detection via Geometric Consistency and Feature Alignment" (Wang et al., 2020)
- Paper: "ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection" (Yang et al., 2021)
-
Few-shot Learning for Fine-grained Action Recognition
Overview: Create a few-shot learning approach for recognizing fine-grained actions in videos, enabling quick adaptation to new action classes or domains with limited labeled examples.
Resources:
- Paper: "Few-Shot Action Recognition via Permutation-Invariant Attention" (Zhang et al., 2020)
- Paper: "Compositional Few-Shot Recognition with Primitive Discovery and Enhancing" (Li et al., 2020)
-
Adversarial Training for Robust Gaze Estimation
Overview: Implement adversarial training techniques to improve the robustness of gaze estimation models against variations in head pose, eye appearance, and environmental conditions.
Resources:
- Paper: "Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression" (Wang et al., 2019)
- Paper: "Few-Shot Adaptive Gaze Estimation" (Park et al., 2019)
-
Graph-based Reasoning for Visual Question Answering
Overview: Develop a graph-based reasoning framework for visual question answering that can capture and utilize complex relationships between objects and concepts in images to answer diverse and challenging questions.
Resources:
- Paper: "Graph-Structured Representations for Visual Question Answering" (Teney et al., 2017)
- Paper: "Relation-Aware Graph Attention Network for Visual Question Answering" (Li et al., 2019)
-
Self-supervised Learning for 6D Object Pose Estimation
Overview: Create a self-supervised learning approach for estimating the 6D pose (position and orientation) of objects in images or point clouds, eliminating the need for large amounts of manually annotated pose data.
Resources:
- Paper: "Self-Supervised 6D Object Pose Estimation for Robot Manipulation" (Wang et al., 2020)
- Paper: "LatentFusion: End-to-End Differentiable Reconstruction and Rendering for Unseen Object Pose Estimation" (Park et al., 2020)
