Data Engineer
Location
San Francisco
Remote
Responsibilities
We are looking for a Data Engineer who can help with building data pipelines as we ingest and process data from different chains to compute reputation. In addition to contributing to the development of core computation blocks of a protocol, this person will be expected to contribute to building out data infrastructure components. Data pipelines will support both batch as well as streaming processing. Specific examples include:
A potential candidate would have some experience with building and/or maintaining big data pipelines (100s of GBs to TBs or more) - ingesting large amounts of data, indexing the data, processing it, and making it available for querying at scale.
Transform the extracted data streams into an optimized storage solution
Develop a scalable indexing service that serves the transformed data for consumption by compute clusters
Implement distributed algorithms that compute recommendation/reputation scores from the transformed data stream
Develop external APIs that serve third-party applications with recommendations and reputation scores
Qualifications
4+ years experience in software development
1+ Database Technologies: SQL, NoSQL; must be able to design and improve DB schema or key structure optimized for complex query patterns
2+ languages: Go, Python, Rust, Javascript/TypeScript; proficiency in Rust or Go preferred
Experience with smart contract development
Cloud infra services (AWS, Google Cloud)
Open-source project experience preferred
Compensation and Perks
Competitive Salary and Equity/Tokens
Top-tier health benefits (medical, dental, vision)
Monthly team events and quarterly team offsite; work with experienced crypto builders
Part-time or Full-time positions available
Flexible and remote-working environment
How to Apply
Email us at [email protected]
Include the role's title in your subject line.
Send along links to relevant things you've built: github link, project link, CV
Feel free to share - what you’re most excited about in web3 (optional).