Twitter Data ETL for Sentiment Analysis
- Tech Stack: Python, HTML, CSS, Apache Airflow, AWS (EC2, S3)
- Created a web‑based application to provide the user with a detailed analysis of the sentiment of users on top 10 trending movies and songs.
- Scheduled a routine to fetch 1000 tweets at a time from Twitter; reducing overall response time by 50%; stored data in AWS S3 table for efficiently displaying data.
- Tested the scalability of web application by generating 10000 user requests using Apache Beam.