Sep 2021
Present
Data Specialist
Forage AI
New York, US
Data Automation
- Engaged in web scraping duties, including resolving captcha challenges, while collaborating with clients to comprehend their business challenges and deliver tailored, data-driven solutions effectively.
- Developed robust scraping tools at scale, emphasizing data integrity, health, and monitoring for accuracy and consistency.
- Designed and executed crawling architectures and systems to efficiently extract data from diverse online sources.
- Utilized expertise to fetch, cleanse, and store data regularly, ensuring quality and usability.
- Worked closely with cross-functional teams to grasp business needs and deliver top-notch solutions aligned with client requirements.
Projects:
Healthcare Data Aggregation(Python Web Scraping):
- Implemented a comprehensive web scraping solution using Python to gather critical data from diverse healthcare sources.
- Adding SQL script for automation QA to flag the error patterns in the output.
- Data cleaning using python scripts.
Project: E-commerce Product Price Monitoring Tool
- Developed an e-commerce product price monitoring tool to track competitor prices and market trends.
- Utilized automated web scraping techniques to gather real-time pricing data, overcoming challenges such as dynamic website structures and anti-scraping measures.
- Developed data analysis algorithms to identify pricing patterns and inform pricing strategies. Collaborated with the marketing team to optimize product pricing based on competitive insights.
loading...