Web Scraping Engineer - Python Technologies

Position Summary : The Data Scraping & Extraction Specialist will be responsible to perform web-scraping & web-acquisition activities that enable efficient scraping of data from online sources. Build effective & sustainable data-scraping tasks to support continuous data acquisition. Collaborate with various teams to support building a seamless ecosystem of data acquisition strategies. Job Responsibility : - Build intermediate to complex scripts, data expressions using Python and other web-scraping technology & ecosystem that are relevant to collect data which are to collect North American government spending, bids, contacts information. - Use knowledge and experience of data scraping tools, platforms, services to acquire and filter information from web sources that should continue to sustain data collection efforts. - The relevancy of data, and quality information are the key. - Apply data analysis and cleansing techniques to filter the right data requirement. - Research various web sources to identify the availability of relevant data as well as ensure sustainability of acquiring the data for periods to come using web harvesting applications, tools and techniques. - Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs. Job Requirements : - Bachelor degree in information technology or computer science or similar. - Strong command over Python to support web-scraping. - Hands-on experience with JavaScript based web-scraping as well as comfortable with generic and specialized tools available in the market like, scrapy, mozenda, web watcher, django etc. - Thorough experience in writing complex scripts for data scraping & strong understanding of data scraping technologies & ecosystem. - Ability to filter important information from massive data points, preferred experience in North. - American information services markets. - Good critical-thinking & problem-solving skills to compose robust solutions. - Great communication skills and ability to navigate in undirected situations. - Experience : 4 to 5 years of exposure in data scraping, acquisition applications, tools. - Preferred to work from office minimum of three days in a week. Job Exposure : - Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources. - In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications. - Effectively collaboration with IT team to design the tailor-made solutions basis upon clients' requirement. - Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution. (ref:hirist.tech)

Location: ahmedabad, IN

Posted Date: 11/23/2024