👋 Hello, I'm Siti Nuraini
System Engineer | Data Engineer
About Me
Aspiring Data Engineer and DevOps professional with practical experience in Python, Fedora Linux, and open-source technologies. Proven track record in designing data pipelines, automating infrastructure tasks, and optimizing system performance. Adept at collaborating with cross-functional teams to deliver solutions that meet both technical and business objectives. Graduating with a Bachelor’s Degree in Information Technology (CGPA 3.79), with additional experience volunteering at PyCon Malaysia. Seeking opportunities to apply data engineering and DevOps expertise to drive innovation and efficiency. Venturing into the IT industry after 8 years working in the Construction Industry. Works well under a Participative Leadership.
Skills
Python , FastAPI 🚀, Streamlit 🎈, Apache Airflow , Docker , SQL , Linux , Git
Professional Experience
- Built and scheduled complex data pipelines using Apache Airflow, automating workflows for large-scale data processing.
- Ensured compliance and data protection through Apache Ranger-based governance, managing permissions and audits.
- Implemented end-to-end ETL processes, integrating diverse datasets with a focus on data quality and scalability.
- Diagnosed and resolved performance bottlenecks in data pipelines, maintaining high data integrity and reliability.
- Collaborated with developers, data scientists, and IT teams to integrate data solutions into existing systems seamlessly.
- Stayed updated on emerging data engineering tools, frameworks, and best practices to drive continuous improvements.
- Deployed, configured, and optimized Fedora Linux servers, ensuring system stability and security.
- Automated server configuration, application deployment, and infrastructure orchestration using Ansible.
- Supported reliable and scalable IT infrastructures, leveraging virtualization and basic cloud concepts.
- Troubleshot system incidents, reducing downtime and streamlining recovery procedures.
- Cooperated with cross-functional teams to align system requirements andaddress operational challenges.
- Kept current with new trends and standards in system engineering to continuously refine environment setup.
- Implemented Python, GoLang, and PHP scripts for data handling with PostgreSQL and SQLite, enhancing cross-language pipelines.
- Containerized PostgreSQL databases using Docker for consistent and efficient deployment across environments.
- Conducted ETL processes for SPRM Data Pesalah Rasuah, ensuring data integrity and accuracy.
- Developed modular microservices for a Stable-Diffusion AI Image Generator, enabling scalable image processing.
- Installed and configured FreeNAS, including ZFS pools and RAID (RAIDZ, RAIDZ2), to optimize storage performance and data redundancy.
- Set up backup and snapshot strategies to safeguard data and enable rapid disaster recovery.
- Enforced security measures via firewall rules, encryption, and user permission management.
- Monitored system health and logs to anticipate issues, reducing downtime through proactive resolutions.
- Documented configurations and procedures to streamline onboarding and system maintenance.
Education
- Bachelor’s Degree in Information Technology, Open University Malaysia (2024)
- Diploma in Quantity Surveying, UiTM Seri Iskandar (2010)
Notable Projects
A web application built with FastAPI to manage a digital library, featuring CRUD operations for books, user authentication, and RESTful API endpoints. Deployed on GitHub Pages with a clean UI.
View ProjectDelivered a comprehensive session on Apache Airflow for new team members, covering DAG creation, scheduling, monitoring, and best practices for workflow orchestration.
Contact
📧 Email: sitinuraini.ma@gmail.com