Promote Project
Senior Web Scraping Engineer Python Job at Promote Project in Poland
Promote Project, Poland, NY, US, 13431
Senior Web Scraping Engineer Python
Location: Poland
Job type: Remote
Overview
We’re a team of 500+ professionals who develop cutting‑edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies. You’ll solve complex challenges and maintain our own infrastructure handling 60PB+ monthly data traffic.
What’s in store for you
60PB+ monthly data traffic through our systems
6PB+ Ceph storage
300k+ service requests/sec processed
500k+ Kafka messages/sec streamed
Why you’ll love it
We run one of the most advanced and largest scraping and parsing products in the world. Our scrapers and parsers are used by leading e‑commerce, market‑intelligence, and AI industry players. The team is a blend of different personalities from diverse backgrounds. We support you in learning how to build your own scrapers and share all tips, tricks, and hacks so you’re onboard quickly.
Your day‑to‑day
Develop scalable scrapers.
Define resilient scraping strategies and unblock websites.
Improve system observability.
Develop back‑end solutions for scraping & parsing problems of various magnitudes.
Maintain the current system and develop new features related to scraping & parsing.
Your skills & experience
Experience working with Python.
Understanding of computer science fundamentals (data structures, algorithms, computability, and complexity).
Version control skills using Git.
Knowledge of how to unblock websites for scraping.
Ability to use different scraping techniques & open‑source tools to build scrapers.
Comfortable with Dev Tools.
Network (TLS/SSL) knowledge.
Worked with browser automations.
Knowledge of asynchronous programming.
Nice to have
Web development knowledge.
Knowledge of CSS selectors/XPaths for parsing.
Experience with Go & C++.
Worked on browser source code.
Knowledge of any front‑end framework.
Experience with Pydantic, FastAPI, SQLAlchemy.
Experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, and monitoring tools like Grafana, Prometheus.
Experience with machine learning in domain‑specific scraping.
Experience building scalable systems.
Desired salary: Gross 5600 EUR/month, negotiable based on skills.
Salary
Gross salary from 5600 EUR/month, open to negotiation.
Up for the challenge? Let’s talk!
Please mention the word PROUD and tag RMzQuMzQuMjMzLjQ0 when applying to show you read the job post completely (#RMzQuMzQuMjMzLjQ0).
#J-18808-Ljbffr