Mid-level Big Data Engineer

We are looking for a mid-level big data engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Designing and Implementation
  • Acountability of all technical aspects of software development for assigned application
  • Utilize the data structure and algorithms to make the system more efficient
  • Support ongoing refactoring of code, utilize visualization and other techniques to fast-track concepts and deliver continuous improvement
  • Analyze, monitor and optimize for performance
  • Write code and unit tests, work on API specs, automation and testing
  • Produce and maintain high-quality technical documentation
Scope of Work
  • Will gain new knowledge from upcoming research and applying it to design and development
  • Develop deep understanding of tie-ins with other systems/platforms within the supported domains
  • Share the gained knowledge with other team members through interactive sessions
  • Identify opportunities to adopt innovative technologies
  • Works with Technical Product Owners and Principal Data Engineers to prioritize features for ongoing sprints and managing the list of technical requirements based on new known issues
  • Provide continuous support for design, development and application availability
  • 3+ years of experience in developing software applications including: analysis, design, coding, testing, deploying and supporting of applications
  • BS degree in Computer Science, Applied Mathematics, Physics, Statistics or area of study related to data sciences and data mining
  • Understand application/software development and design in an Agile environment
  • Inquisitive on Big Data technology; current on new ideas and tools
  • Good understanding of Data structures and Designing of Algorithms
  • Awareness of new and emerging Big Data technologies and trends
  • Good understanding of basic mathematical concepts and ability to grasp complex mathematics
  • Proficient in at least one programming language - R, Java, Scala, Python, C/C++
  • Collaborative personality, able to engage in interactive discussions with the rest of the team
Preferred Qualifications:
  • Experience with Hadoop stack (Map Reduce, Kafka, Pig, Hive, HBase, Cassandra, YARN) and/or BDAS (Scala/Spark)
  • Experience working on projects facilitating true CI/CD (Jenkins, Drone, etc.)
  • Exposure to DevOps tools and culture (i.e. Kubernetes, Docker, Jenkins, Git, etc.)
  • Awareness of new and emerging Big Data technologies and trends
Searchable Design Perks & Benefits
  • Minimum 20 hrs of commitment required.
  • Compensation: Transportation stipend, lunch (or snacks) is provided at the office.
  • Innovative working environment.