menú

Data Engineer

Apply for this job ▸
Data Engineer2018-12-10T09:00:05-05:00<p><span style="font-weight: 400;">ThoughtWorks India is looking for talented data engineers passionate about building large scale data processing systems to help manage the ever-growing information needs of our clients.</span></p> <p><span style="font-weight: 400;">You will be responsible for -</span></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Creating complex data processing pipelines, as part of diverse, high energy teams</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Designing scalable implementations of the models developed by our Data Scientists</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Hands-on programming based on TDD, usually in a pair programming environment</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Deploying data pipelines in production based on Continuous Delivery practices</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Advising clients on the usage of different distributed storage and computing technologies from the plethora of options available in the ecosystem</span></li> </ul> <p><span style="font-weight: 400;">Ideally, you should have - </span></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Minimum of 3 years of overall industry experience</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">2 to 3 years of experience building and deploying large scale data processing pipelines in a production environment</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Experience building data</span><span style="font-weight: 400;"> pipelines and data centric applications using distributed storage platforms like HDFS, S3, NoSql databases (Hbase, Cassandra, etc) and distributed processing platforms like Hadoop, Spark, Hive, Oozie, Airflow, etc in a production setting</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Hands on experience in MapR, Cloudera, Hortonworks  and/o</span><span style="font-weight: 400;">r Cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Experience working with, or an interest in Agile Methodologies, such as Extreme Programming (XP) and Scrum</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Knowledge of software best practices, like Test-Driven Development (TDD) and Continuous Integration (CI)</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Strong communication and client-facing skills with the ability to work in a consulting environment is essential</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Senior developers (6+ years) are expected to be the Architect for small and large enterprise projects. On larger projects, you are expected to work closely with the fellow architects to come up with the architecture and take it further.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Desire to contribute to the wider technical community through collaboration, coaching, and mentoring of other technologists </span></li> </ul> <p><span style="font-weight: 400;">We are hiring in 4 cities in India - Bangalore, Gurgaon, Pune and Hyderabad. If you relish the idea of being part of a community that extends beyond the work we do for our customers, you may find ThoughtWorks is the right place for you. If you share our passion for technology and want to help change the world with software, we want to hear from you!</span></p>ThoughtworksHyderabadIndia