Job Overview

We’re looking for a Data Engineer to improve and transform our expanding data capabilities. Reporting to the Head of Data, the Data Engineer will collaborate closely with Data Science, Product, and Engineering to maintain and optimize our data infrastructure and analytics stack. The ideal candidate will have a background in a technical field, will have expertise working with large production data sets, and will have experience building & maintaining a Data Warehouse. This position will be fully remote.

Duties & Responsibilities

Design and Implement Data Solutions: Translate business requirements and end-to-end designs into technical implementations that align with VRChat's objectives.
Data Warehouse Management: Build and maintain both batch and real-time data warehousing solutions using Snowflake on AWS to support VRChat's data needs.
ETL Pipeline Development: Develop complex data pipelines using SQL queries and Python scripts to manage data extraction, transformation, and loading (ETL) processes.
Data Orchestration: Implement and manage data orchestration tools (e.g., Dagster, Apache Airflow) to ensure seamless data workflow automation.
Data Integration: Integrate diverse data sources, including MongoDB and SQL databases (e.g., Postgres, MySQL), facilitating comprehensive data analysis and decision-making processes.
Infrastructure Scalability: Ensure the scalability and performance of data infrastructure to accommodate VRChat's growing data needs, leveraging technologies like Spark.
System Upgrades and Rollouts: Participate in system rollouts, upgrades, and implementation of data system changes to streamline internal practices and support business growth.
Cross-Functional Collaboration: Collaborate with Data Science, Product, and Engineering teams to build and maintain data products that drive VRChat's innovation.
Data Privacy and Security: Ensure compliance with data privacy regulations and ethical standards in data handling, prioritizing user privacy and data security.
Monitoring and Optimization: Monitor data system performance and resolve issues to ensure uninterrupted data processing and optimal system functionality.
Stay Updated: Keep up to date on the latest technologies and practices in data engineering to continuously improve VRChat's data infrastructure.

Experience, Skills & Qualifications

Experience: 3+ years in data engineering.
Technical Proficiency: Expert in SQL and Python for data pipeline development.
Data Warehousing: Experience with data warehousing concepts and Snowflake.
Database Knowledge: Familiarity with MongoDB and SQL databases (e.g., Postgres, MySQL).
Cloud Services: Extensive experience with AWS or other cloud services.
Data Orchestration: Experience with tools like Dagster or Apache Airflow.
Communication: Excellent interpersonal and communication skills.
Problem-Solving: Strong analytical and problem-solving abilities.
Team Collaboration: Proven ability to work collaboratively in cross-functional teams.

Bonus Points

Industry Experience: Experience in data engineering at a consumer technology, social media, or gaming company.
Passion for Technology: Interest in social technology, gaming, or immersive experiences.
Snowflake Expertise: Extensive experience with Snowflake.
Distributed Computing Engines: Familiarity with engines like Spark, Flink, or Hive.
Streaming Platforms: Experience with Kafka, Kinesis, or other streaming platforms.
VR and Gaming: Understanding of VR, AR, and online communities.
Certifications: Relevant certifications (e.g., SnowPro, AWS Certified Data Analytics) are a plus.
Unity 3D: Basic understanding of Unity 3D development.
Social Platforms: Experience with social platforms, social gaming, or interactive online environments.
Innovative Thinking: Ability to think creatively and solve complex data challenges.
Cloud ETL Tools: Experience with cloud-based ETL tools (e.g., Fivetran,Glue, Hevo).

Data Engineer

Anywhere in the world

Remote

Senior

VRChat Inc.