Role: Software Engineer (Backend)Experience: 3+ YearsTech Stack: Python, ClickHouse, ElasticSearch, Postgres, Redis, and Neo4jLocation: Remote
**Note: This position is with one of our hiring partners
Position Overview:The Core Data Ingest team is comprised of engineers who work cross-functionally to build data pipelines that enable us to ingest valuable information to further enhance the attribution displayed to our customers in our product. As a Software Engineer on the Core Data Ingestion team, you will be responsible for executing mission-critical systems and data services that ingest and analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.
The Impact You’ll Have Here:Build highly reliable data services to integrate with dozens of blockchains.Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance our partner’s products.
What We’re Looking For:Write high-quality code. We mostly work in Python. However, languages can be learned: we care much more about your general engineering skill than knowledge of a particular language or framework.Versatility. Experience across the entire spectrum of data engineering, including:Data stores (e.g., ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j)Data pipeline and workflow orchestration tools (e.g., Airflow, DBT, Luigi, Azkaban, Storm)Data processing technologies and streaming workflows (e.g., Spark, Kafka, Flink)Deployment and monitoring infrastructure in public cloud platforms (e.g., Docker, Terraform, Kubernetes, Datadog)Loading, querying, and transforming large data setsComfort working with noisy, dirty, and unstructured data to cleanse, scrape and convert it into structured dataA high degree of initiative and ownership, combined with the ability to navigate ambiguity and adapt quickly to change.Exceptional ability to structure problems and identify the most critical issues to prioritize.Ability to communicate complex ideas effectively to both technical and non-technical audiences, verbally and in writing.Experience working collaboratively in a cross-functional environment with a diverse group of people at all levels in an organizationPassion for building a safer financial system for billions of people.Interest in virtual currencies, applications, and their use in financial networks and blockchain analysis is a plus.
About Pesto Tech:Pesto is where software developers go to build their career path for the next 5 years. We don't just offer jobs; we provide unparalleled opportunities for your growth and success in the dynamic landscape of Tech Jobs.