Big Data Engineer

Wombi — google analytics for Web3 is looking for Big Data Engineer to join our team on full-time basis. Wombi connects the knowledge about DApp users from the web to their on-chain and in-app activity

‍

Job description

As a member of Wombi team, you will build a large-scale, real-time analytics tool to help web3 developers understand the behavior of their users.‍

‍

Duties and Responsibilities:

• Responsible for the building, deployment, and maintenance of a data platform that processes data quickly at big data scales

• Contributes design, code, configurations, and documentation for components that manage data ingestion, batch processing, data extraction, transformation, and loading across multiple data sources

• Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions

• Works directly with business analysts and data scientists to understand and support their use cases

Required skills:

• Product and a customer-focused mindset

• 4+ years of experience coding in Python or Java with SQL

• 3+ years contributing to production deployments of large backend data processing and analysis systems

• 2+ years of hands-on implementation experience working with a combination of the following technologies: Spark, Kafka/Kinesis, Hive/Glue, Kubernetes/EMR

• 2+ years of experience in cloud data platforms — AWS

• Knowledge of SQL

• Knowledge of Data Lake, design, implementation, and optimization

• Knowledge of BI reports and dashboards design and implementation

• Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations

• Experience designing, documenting, and defending designs for key components in large distributed computing systems

• Ability to handle multiple competing priorities in a fast-paced environment

• Implementing GDPR compliance is a big plus

Education and degree:

Masters or Bachelor's Degree in a quantitative field (Math, Statistics, Computer Science, Engineering, Data Science, Operations Research, etc.).

Specialized knowledge:

• Development Tools (Git, GitLab)

• CI/CD processes

• Understanding of software development company functioning

• Understanding of software development life cycles

Skills and abilities:

• Team playing and result orientation skills

• Self-management skills

• A desire to work in a fast startup environment