Posts

What is act and what problem does it solve? When building pipelines using GitHub Actions, testing code inside our codebase locally is possible. However, as we add more steps to our workflows and push changes to GitHub, we may encounter issues that require repeated iterations of pushing fixes until everything works correctly. This process can be time-consuming and inefficient. To enable faster feedback loops, we can use act tool that allows you to run GitHub Actions locally without needing to push your commits to GitHub. ...

What is Gitleaks? Gitleaks is a Static Application Security Testing (SAST) tool that scans git repositories, files, and directories for secrets. By integrating Gitleaks into your development workflow, you can catch potential vulnerabilities early and prevent them from being committed to your codebase. Why Are Secrets Committed to Code? Secrets, such as tokens, API keys, database passwords, and credentials, are often inadvertently committed to code repositories. This can happen for several reasons: ...

Introduction DuckDB is an open-source analytical database system designed specifically for data wrangling — the process of transforming raw data into a usable format for analysis through discovery, cleaning, enrichment, and validation. DuckDB provides comprehensive library support for Python, R, Java, and WebAssembly (WASM). In this article, we’ll focus on the standard command-line interface (CLI) application and explore its innovative browser-based user interface. DuckDB provides robust support for importing various data formats including CSV, Excel, Parquet, and remote file protocols (e.g., S3 buckets in AWS), making it highly versatile for data integration tasks. ...

What is UV? An extremely fast Python all in one package manager written in Rust. It replaces the following tools and is extremely fast. pip pip-tools pipx poetry pyenv virtualenv Its one tool to rule them all. Install UV Mac and Linux curl -LsSf https://astral.sh/uv/install.sh | sh windows powershell -c "irm https://astral.sh/uv/install.ps1 | iex" Via Python pip install uv Manually installing Python version using UV To download a python versions. This installs python which can be used by uv project and does not mess up your global python ...

Using the linux commands effectively can speed up your workflow. Below are 10 useful linux commands with practical examples. 1. Go back to prior directory You type a long directory and you want to go back to prior directory use cd - user@server.com: /etc $ user@server.com: cd /somepath/long_directory. user@server.com: cd - 2. Clear screen / prior entries Use Ctrl + L to clear prior entries. The old commands are still visible if we scroll up. To remove all entries type reset this will reset the shell. ...