Software Engineer (L3) Data Substrate

Who we are At Twilio, we’re shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences.Our dedication to remote-first work, and strong culture of connection and global inclusion means that no matter your location, you’re part of a vibrant team with diverse experiences making a global impact each day. As we continue to revolutionize how the world interacts, we’re acquiring new skills and experiences that make work feel truly rewarding. Your career at Twilio is in your hands. We use Artificial Intelligence (AI) to help make our hiring process efficient. That said, every hiring decision is made by real Twilions!.See yourself at TwilioJoin the team as Twilio's next Software Engineer on our Data & Analytics PlatformWho we are & why we’re hiringTwilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.Although we're headquartered in San Francisco, we have presence throughout South America, Europe, Asia and Australia. We're on a journey to becoming a global company that actively opposes racism and all forms of oppression and bias. At Twilio, we support diversity, equity & inclusion wherever we do business.About the jobWe are looking for a talented and experienced Software Engineer to join our Data Platform team. In this role, you will play a crucial part in designing, building, and optimizing our platform to support a wide range of data-driven initiatives. You will work closely with cross-functional teams to understand business requirements, architect scalable solutions, and implement data solutions and infrastructure for our Data Platform. The ideal candidate will have a passion for leveraging data to drive business impact, strong technical skills, and experience with modern data technologies.ResponsibilitiesIn this role, you’ll:Design, build, and maintain infrastructure and scalable frameworks to support data ingestion, processing, and analysis.Collaborate with stakeholders, analysts, and product teams to understand business requirements and translate them into technical solutions.Architect and implement data solutions using modern data technologies such as Kafka, Spark, Hive, Hudi, Presto, Airflow, and cloud-based services like AWS Lakeformation, Glue and Athena. Design and implement frameworks and solutions for performance, reliability, and cost-efficiency.Ensure data quality, integrity, and security throughout the data lifecycle.Stay current with emerging technologies and best practices in big data technologiesMentor early in career engineers and contribute to a culture of continuous learning and improvementQualifications Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!Required:Bachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in software development or a related field.Strong proficiency in programming languages such as Python, Java, or Scala.Strong experience with building frameworks for big data technologies such as Spark, Kafka, Hive, and distributed computing systems.Experience with AWS technologies at scaleSolid understanding of software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices.Excellent problem-solving and analytical skills.Strong verbal & written communication skills, with the ability to work effectively in a cross-functional team environment.Desired:Bias to action, ability to iterate and ship rapidly Passion to build data products, prior projects in this areaLocationThis role will be remote, and based in the United States. This role will be remote but is not eligible to be hired in San Francisco, CA, Oakland, CA, San Jose, CA, or the surrounding areas.Travel We prioritize connection and opportunities to build relationships with our customers and each other. For this role, you may be required to travel occasionally to participate in project or team in-person meetings.What We OfferThere are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.Compensation*Please note this role is open to candidates outside of California, Colorado, Hawai