Lead Data Developer
Chicago, IL
Data developer will develop strategies and solutions to ingest, store and distribute our big data. Our Data Developers use Big Data tools such as, Scala, Hadoop, Spark, Pyspark, Hive, JSON, and SQL in 10 week long scrum teams to developer the products, tools and features.
Responsibilities
- Perform development of Cloud-based (GCP) Big Data solutions
- Perform unit and integration testing
- Collaborate with senior resources to ensure consistent development practices
- Participate in the estimation process for new work and releases
- Bring new perspectives to problems
- Provide mentoring to junior resources
- Participate in retrospective reviews
- Be driven to improve yourself and the way things are done
Requirements
- Bachelor’s degree (typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program) plus 5 years of experience or Master’s degree ((typically in Computer Science, Management Information Systems, Mathematics,
- Business Analytics or another technically strong program) and 3 years experience.
- Solid experience with core Python development (Python 2 & Python 3)
- Proven ability of developing with SQL
- Proven hands-on practical understanding of Public Cloud services and technologies
- Full understanding of ETL concepts
- Solid experience with Big Data tools to include but not limited to, Scala, Google Data Proc, Spark, Pyspark, and Hive
- Strong understanding of Agile Principles (Scrum)
- Proficient with relational and non-relational data modeling
- Full understanding of data warehousing concepts
- Exposure to VCS (Git, SVN)
- Solid experience developing with either Java, Scala or Python
- Good practical understanding of messaging systems such as Kafka or Google Pub-Sub
Preferred Skills
- Exposure to NoSQL (Mongo, Cassandra)
- SOA
- Junit
- CI/CD
- Basic knowledge of “R” language