menu

Senior Data Engineer

Apply for this job ▸
Senior Data Engineer2018-12-05T19:56:28-05:00<div style="text-align: justify;"> <p><span style="font-weight: 400;">ThoughtWorks is helping organisations with ambitious goals change the way they use data and how they build technology in support. This might involve event-driven architecture, continuous delivery of analytics and data science, and prototyping new products and technologies. We are looking for experienced Data Engineers who craft large-scale data processing systems to help manage clients’ ever-growing information.</span></p> <p><strong>The Role</strong></p> <p><span style="font-weight: 400;">As a Data Engineer, you will develop modern data architectural approaches to meet key business objectives and provide end to end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems.</span></p> <p><span style="font-weight: 400;">Some of our recent data projects have been:</span></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">providing technical recommendations with respect to a data architecture strategy</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">delivering an EMR pipeline to determine which ads to show based on a customer segment using Hadoop Streaming to implement MR jobs in Ruby</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">providing a technical assessment and recommendation for a cloud-hosted data analytics platform.</span></li> </ul> <p><span style="font-weight: 400;">On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.</span></p> <p><span style="font-weight: 400;">As a ThoughtWorks’ consultant, you proactively seek out relationships with our new business team and work collaboratively to support pre-sales, meet prospective clients and ultimately influence and shape our portfolio of work. You recognize that building your network with a client is absolutely key to enable you to perform in your role. You'll be drawing on all of your passion for technology, hands-on experience and knowledge of latest Big Data and Engineering best practices to help you gain the respect and credibility of those around you.</span></p> <p><strong>Your background</strong></p> <p><span style="font-weight: 400;">Technical</span></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Deep understanding and application of modern data processing technology stacks. For example Spark, Hadoop ecosystem technologies, Flink, and others</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Deep understanding of streaming data architectures and technologies for real-time and low-latency data processing such as Kafka, Kinesis, Beam, EventHub, and Dataflow</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Deep understanding of persistence technologies including column family, graph, document, and key-value data storage technologies including Apache Cassandra, Google Bigtable, Hive, HBase</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Knowledge of Serverless Compute technologies such as Lambda, Azure Functions, Google Cloud Functions</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Understanding of how to architect solutions for data science and analytics such as productionizing machine learning models and collaborating with data scientists</span></li> </ul> <p><span style="font-weight: 400;">Software Delivery</span></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Background in software development, particularly hands-on in coding, architecting and delivering complex projects</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Understanding of agile development methods including: </span><a href="https://www.thoughtworks.com/insights/blog/what-are-our-core-values-and-practices-building-software"><span style="font-weight: 400;">core values</span></a><span style="font-weight: 400;">, guiding principles, and key agile practices, application of Continuous Integration/Delivery, and quality coding practices (TDD, SOLID, DRY, YAGNI). </span></li> </ul> <p><span style="font-weight: 400;">Consulting</span></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">A rich breadth of industry experience and background working across different organizations, ranging in size, from start-ups to large corporations.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Strong stakeholder management and interaction experience at different levels</span></li> </ul> <p><strong>About ThoughtWorks</strong></p> <p><span style="font-weight: 400;">ThoughtWorks is a global technology and digital transformation consultancy. We are a community of passionate individuals who share a common purpose to revolutionize software design, creation and delivery, while advocating for positive social change. We help organisations challenge the status quo and create meaningful, scalable differentiation at speed through technology and design. We love to get better at what we do, at how we think. We love to learn. We love to share.</span></p> <p><strong>ThoughtWorks’ Culture</strong></p> <p><span style="font-weight: 400;">We are community that nurtures and celebrates talent, irrespective of gender, background and any bias. Diversity is in our DNA and is a core part of our culture. The decisions we make as a business revolve around inclusivity and equality. We are honored to have been awarded as an Employer of Choice for Gender Equality and are proud to say that 48% of ThoughtWorks Australia identify as women, in an industry where the norm is much lower.  Respect, continuous feedback and a non-hierarchical structure are all an important part of our culture. As ThoughtWorkers, we have equal opportunities to grow, share our ideas and even re-invent ourselves.</span></p> <p><strong>What's on offer</strong></p> <p><span style="font-weight: 400;">ThoughtWorks offers a community-oriented environment centred around learning, sharing, growing and feedback. All ThoughtWorkers receive an annual professional development allowance to attend conferences, courses, workshops and to purchase books. Our large network of mentors and coaches provide a supportive environment to connect with the ThoughtWorks' community, as well as the opportunity to develop professionally and personally.</span></p> <p><span style="font-weight: 400;">Other benefits include a generous paid parental leave package, a communications allowance, free and discounted tickets to major industry conferences, and catered Friday lunches as a chance to connect with each other each week.</span></p> <p><span style="font-weight: 400;">If you’d like to find your home in tech at ThoughtWorks, please apply. </span></p> </div> <div> <p class="" style="text-align: justify;"> </p> <p class="p1" style="color: white;"><span class="s1">#LI-AUSTRALIA</span></p> <div> </div> </div>ThoughtworksMelbourneAustralia