Logo
Promote Project

Senior Web Scraping Engineer Python Job at Promote Project in Poland

Promote Project, Poland, NY, US, 13431

Save Job

Senior Web Scraping Engineer Python Location: Poland Job type: Remote Overview We’re a team of 500+ professionals who develop cutting‑edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies. You’ll solve complex challenges and maintain our own infrastructure handling 60PB+ monthly data traffic. What’s in store for you 60PB+ monthly data traffic through our systems 6PB+ Ceph storage 300k+ service requests/sec processed 500k+ Kafka messages/sec streamed Why you’ll love it We run one of the most advanced and largest scraping and parsing products in the world. Our scrapers and parsers are used by leading e‑commerce, market‑intelligence, and AI industry players. The team is a blend of different personalities from diverse backgrounds. We support you in learning how to build your own scrapers and share all tips, tricks, and hacks so you’re onboard quickly. Your day‑to‑day Develop scalable scrapers. Define resilient scraping strategies and unblock websites. Improve system observability. Develop back‑end solutions for scraping & parsing problems of various magnitudes. Maintain the current system and develop new features related to scraping & parsing. Your skills & experience Experience working with Python. Understanding of computer science fundamentals (data structures, algorithms, computability, and complexity). Version control skills using Git. Knowledge of how to unblock websites for scraping. Ability to use different scraping techniques & open‑source tools to build scrapers. Comfortable with Dev Tools. Network (TLS/SSL) knowledge. Worked with browser automations. Knowledge of asynchronous programming. Nice to have Web development knowledge. Knowledge of CSS selectors/XPaths for parsing. Experience with Go & C++. Worked on browser source code. Knowledge of any front‑end framework. Experience with Pydantic, FastAPI, SQLAlchemy. Experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, and monitoring tools like Grafana, Prometheus. Experience with machine learning in domain‑specific scraping. Experience building scalable systems. Desired salary: Gross 5600 EUR/month, negotiable based on skills. Salary Gross salary from 5600 EUR/month, open to negotiation. Up for the challenge? Let’s talk! Please mention the word PROUD and tag RMzQuMzQuMjMzLjQ0 when applying to show you read the job post completely (#RMzQuMzQuMjMzLjQ0). #J-18808-Ljbffr