Logo FH Oberösterreich

Data Engineer

Job

  • Level
    Erfahren
  • Job Feld
    Data
  • Anstellung
    Vollzeit
  • Vertragsart
    Unbefristetes Dienstverhältnis
  • Gehalt
    ab 44.800 € Brutto/Jahr
  • Ort
    Wien
  • Arbeitsmodell
    Hybrid
  • Job Technologien

    Deine Rolle im Team

    1. Developing scripts for the extraction of structured and non-structured information (e.g. SQL databases, csv, xlsx, xml, txt, web pages and others).
    2. Design data models considering best practices regarding efficiency and information security.
    3. Create dedicated scripts to perform data transformation and store in redundant repositories.
    4. Evaluate and collaborate in the implementation of solutions for handling big data environments.
    5. Optimize legacy ETL processes and perform new developments.
    6. Document the data processing pipelines and manage the code versioning.
    7. Collaborate with the engineering team in the development or modification of the core existing platforms.
    8. Contribute to publications
    9. Take operational responsibility for the components that you develop.

    Unsere Erwartungen an dich

    Ausbildung

    • MSC - Degree in computer science / software engineering

    Qualifikationen

    • Deep understanding of the web scrapping approach, web pages structures and techniques to extract information.
    • Using of parallelism in the execution of ETL process, execution based on events.
    • Using of Amazon cloud computing resources like EMR and S3 storage.
    • Use of Graph Database Neo4j and Cypher query language.
    • Working in an environment where you constantly experiment and iterate quickly

    Erfahrung

    • Experience using Python as programing language focus on data field (e.g. Anaconda, Jupyter Notebook, Pandas, Dask, PySpark, Numpy, Scikit, others).
    • Experience with the RDBMS and of SQL query language, database optimizations, indexing, replications.
    • Experience with NOSQL resources, like ElasticSearch, MongoDB, Apache Cassandra,etc.
    • Data lake principles and practical experience with big data solutions (e.g. Hadoop, Apache Spark)
    • Experience with deployment ETL process in Docker containers.
    • Experience with secure data at transit and rest (encryption) and techniques for clustering and replication implementation.

    Job Standorte

    Map of company locations
    • Standort Wien

      Standort Wien

      Österreich

    Das ist dein Arbeitgeber

    FH Oberösterreich

    FH Oberösterreich

    Die Fachhochschulen Oberösterreich bieten an vier verschiedenen Standorten ein breites Spektrum an Studiengängen an.

    Description

  • Unternehmenstyp
    Etablierte Firma
  • Arbeitsmodell
    Hybrid
  • Branche
    Bildungswesen
  • Logo FH Oberösterreich

    Data Engineer

    Gehalt
    ab 44.800 € Brutto/Jahr
    Ort
    Wien
    Arbeitsmodell
    Hybrid

    Weitere Jobs