Home / Jobs / Backend/Data Engineer | Publiremote.com

Share:
Facebook Twitter Linkedin WhatsApp

Published 2023-04-25

Backend/Data Engineer


Backend/Data Engineer

Company details

Type of job: Remote
Country: United States
City: New York
Company: Blue Orange Digital


Description of the offer

Company Overview:

Blue Orange Digital is a cloud-based data transformation and predictive analytics development firm with offices in NYC and Washington, DC. From startups to Fortune 500’s, we help companies make sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Founded by engineers, we love passionate technologists and data analysts. Our startup DNA means everyone on the team makes a direct contribution to the growth of the company.

Position Overview: 

We are seeking a Backend Engineer to join our product development team to help build, optimize, maintain, and support the data pipeline management components of our product. Your main tasks will include developing, refactoring, customizing, and maintaining our data source integration (DSI) platform with multiple partner-built data observability platforms. You will join a small team of engineers and have a large impact on shaping how the product is built and designed.

Responsibilities: 

  • Be proficient in server-side development, automation, and optimization of data pipelines, including database creation and management, and debugging
  • Integrate data from various backend services, APIs, and databases
  • Create and maintain software documentation
  • Create and analyze reliable and secure backend functionality
  • Build and maintain infrastructure and automation to support the running of the platform across multiple cloud environments
  • Remain knowledgeable of emerging technologies/industry trends and apply them to operations

Requirements (must have): 

  • Expert-level knowledge and experience in Python
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Experience building, refactoring, customizing, and optimizing ‘big data’ data pipelines, architectures, and data sets
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
  • Strong analytic skills related to working with both structured and unstructured datasets
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management
  • A successful history of manipulating, processing, and extracting value from large disconnected datasets
  • Strong project management, organizational, and collaboration skills
  • Experience supporting and working with cross-functional teams in a dynamic environment
  • We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a degree in Computer Science or another related field
  • Experience using the following software/tools:
    • Experience with relational databases: Postgres, MySQL, MS SQL, etc.
    • Experience with ELT/ETL tools: Meltano, Airbyte, or Fivetran
    • Experience with data pipeline and orchestrator tools: Dagster, Airflow, or Kubeflow
    • Experience with AWS cloud services: EC2, EKS, EMR, RDS, Redshift, and S3 (for data lake usage)
    • Experience with at least one of the object-oriented/object-function scripting languages: Python, Java, or Scala
  • Must have experience with DevOps tools:
    • Experience with IaC such as Terraform
    • Experience with Docker and container orchestration with Kubernetes
    • Experience with CI/CD tools: GitHub or Gitlab

Bonus points:

  • Hold certifications for cloud providers (AWS, Azure, or GCP) and Snowflake.
  • Experience using the following software/tools:
    • Experience with big data tools: Spark (Scala or PySpark), Kafka, Hive, and Hadoop.
    • Experience with NoSQL databases: MongoDB or Cassandra
    • Experience with Data Warehouses: Snowflake, Redshift or BigQuery
  • Experience with observability tools for metadata catalog, data lineage, and data quality

Our Benefits Include:

  • Fully remote
  • Flexible Schedule
  • Unlimited Paid Time Off (PTO)
  • Paid parental/bereavement leave
  • Worldwide recognized clients to build skills for an excellent resume
  • Top-notch team to learn and grow with

Salary: $60,000 – $72,000 USD per year

Blue Orange Digital is an equal-opportunity employer.

Background checks may be required for certain positions/projects.


How to apply?

Click on the button to get the company email or employment application form.
Apply on home page
Tags:


More options: Modify job, Delete job

Remember that you do not have to pay to participate in selection processes. Protect yourself from fraud with our Security Tips. If they ask you for money for an application you can Report job.


Promote your Job

Promote your job offer in the first positions.
$30USD for 30 days

Promote now

 

Top cities

Featured links

Follow us on Instagram @publiremote

@publiremote

 

 


Recents jobs

Published Monday 2 de September, 2024

Senior Copywriter



ezCater is the leading food for work technology company in the US, connecting anyone who needs food for their workplace to over 100,000



Published Sunday 1 de September, 2024

Account Manager

castLabs
Remote
Worldwide

Dive into the digital expanse as our new Account Manager, open to applicants of all genders! This position provides the opportunity to immerse



Published Sunday 1 de September, 2024

Office Assistant

Coalition Technologies
Remote
United States

WHY YOU SHOULD APPLY: Coalition Technologies is devoted to delivering clients the highest quality work while providing our team a fun, thriving, and