BGI has the following full time opportunity with our direct client located in NY, NY
Role Background
The Data Engineer will work alongside the entire software engineering team and reports directly to the Director of Engineering. The Data Engineer should be comfortable with changing priorities, specs, and deadlines.
Candidate Accomplishments
In first 6 months, this person needs to learn stack well enough to be able to contribute individually to their flagship product and two new, large-scale products (ad sales tool and customer data tool)
-
After 6 months, this person should be a self-sufficient individual contributor using our client’s stack
-
If the person hasn’t worked with columnar databases before this, they should by now have learned how to use them and be able to work within them independently
Candidate Attributes
“Day in the Life”
? Will code regularly as an individual contributor in a semi-Agile environment
? Participate in standup
? Participate in sprint planning
? Spend up to 80% of own time coding
Priorities
Priority 1:? Solid coding skills in the core elements of 605’s stack - Spark, Redshift, Hadoop, Java or Scala - they should be very proficient in some of these specific technologies, while being proficient in substitutes for most others (e.g. Vertica for
Redshift, C++ or another lower-level language instead of Java) - and they should have experience with both dynamically typed (Python, Ruby) and statically typed (Scala, Java, C++) languages
? Priority 2:? Expert knowledge of data structures, big data and its issues, algorithms, and the client's stack. They should have worked with at least 100 million rows of data and dealt with distributed storage and processing of a large amount of data.
? Priority 3: ?Ability to work in an Agile environment (self-directed, collaborative, flexible)
? Priority 4: ?Motivated to work on a small team and make significant contributions to the codebase quickly
? Priority 5: ?Knowledge of ETL, Machine Learning, etc. a plus