Greetings! My name is Nixon, and I'm excited to share my still developing data engineer portfolio. Within this repository, you'll find a comprehensive catalog of projects completed in various data analytics/engineering courses or self development exercises, each of which covers essential skills and techniques.
- Brief overview: Selenium tool used to extract data from Prakiraan Cuaca BMKG Website, Harga Pangan Pasar Tradisional PIHPS, dan Harga Pangan Pasar Modern PIHPS. Create a dataset with Indonesia weather forecast and food prices.
- Technology used: Python, Selenium, Pandas
- Final results: Output as CSV for food prices info and with additional for weather info
- Brief overview: Integrate heterogeneous data sources for smart farming environment, consist of web scraping data, sensor data, and also images and videos.
- Technology used: Python, Selenium, Pandas, Airflow, Hadoop, Metabase, Linux
- Final results: Dashboard
- Brief overview: Doing sentiment analysis on twitter data streams to find out public reaction to the latest films/music (in this case, we are using Cupid from FIFTY-FIFTY song)
- Technologgy used: Python, Pandas, PySpark, Kafka, Docker
- Final results: The sentiment comes as output in command line, and also with the visualization
