Hari Sekhon - Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, Security, AWS, GCP etc
Work in progress to gradually migrate my huge private personal knowledge base into this public repo.
Hit the watch button on the top right for updates.
This repo focuses on advanced knowledge, tips & tricks, performance tuning, troubleshooting, debugging, workarounds & fixes.
Much more advanced knowledge is captured in code and code comments. References to my major GitHub Repos are provided throughout where relevant.
References to official docs and some classic books are provided for those who want to thoroughly cover the basics.
Some of these pages are still in progress pending porting and populated yet from my private knowledge base pages, some are stubs pending migration.
Hit the watch button on the top right for updates.
- GitHub Repos
- Operating Systems
- Core Services - DNS, DHCP, SSH, FTP
- Editors
- Terminal Multiplexers
- Architecture & Documentation
- Git
- Cloud
- Docker
- Kubernetes
- Container Security
- Programming
- Configuration Management
- Build Systems
- Container Registries
- Artifact Registries
- CI/CD
- Code Scanning
- Internet Services
- Databases / RDBMS
- NoSQL
- Caching
- Search
- Pub/Sub & Message Queues
- Data
- Hadoop Ecosystem
- Data Science
- Time Series Databases
- Visualization
- Performance Engineering
- Security
- Virtualization
- Hardware
- Networking
- Load Balancing
- Monitoring
- Vendors
- Miscellaneous
- Work
- Old
- Star History
- Meme
- More Core Repos
Full of open source tools and scripts used throughout the rest of these docs to make it easier to install and operate these technologies:
- DevOps-Bash-tools - 1000+ Bash scripts, advanced shell environment customizations, quick installation scripts and dot configs
- DevOps-Python-tools - 80+ Python programs for DevOps & Data
- DevOps-Perl-tools - 25+ Perl programs for DevOps
- DevOps-Golang-tools - a handful of Golang programs
- Kubernetes-configs - production ready checklist and deployment configs for many Kubernetes applications
- SQL-scripts - 100+ database scripts
- Templates - templates for many common file formats for programming languages, build systems and DevOps configs
- Diagrams-as-Code - Cloud & Open Source architecture diagrams
- Architecture TODO
- Product Selection TODO
- Diagrams-as-Code
- Documentation
- Microservices TODO
- Medium.com (blog)
- Systems Design
- Git
- Git Repo Hosting Providers:
- GitHub TODO
- GitLab
- Azure DevOps TODO
- Bitbucket TODO
- Pre-Commit
- Cloud Platforms:
- Third Party Tools:
- PaaS
- Docker Desktop embedded Kubernetes (easiest to use)
- MiniKube
- MiniShift - for OpenShift upstream okd
- K3d
- Kind
- Container Scanning
- Trivy TODO
- Grype TODO
- Clair
- Programming
- Binary Debugging
- Perl
- Python
- Anaconda TODO
- Golang TODO
- R TODO
- JVM:
- APIs
- Regular Expressions
- DockerHub
- AWS ECR
- GCP GAR
- GCP GCR (deprecated / shut down)
- Azure ACR
- GitHub GHCR
- Redhat Quay.io (there is an on-prem installable too)
- JFrog Container Registry
- Nexus
- Harbor
- Chart Museum
- CI/CD
- Self-Hosted CI/CD:
- Jenkins
- Jenkins-on-Kubernetes
- HariSekhon/Jenkins - master
Jenkinsfiletemplate and Groovy Shared Library functions
- TeamCity TODO
- Concourse
- GoCD TODO
- Jenkins
- Git Repo Providers hosted CI/CD:
- GitHub Actions
- GitLab CI TODO
- Azure DevOps TODO
- Bitbucket Pipelines TODO
- 3rd Party hosted CI/CD:
- SQL TODO
- SQL scripts
- Databases
- Data Warehousing TODO
- MySQL TODO
- PostgreSQL TODO
- CloudBeaver
Massively Parallel Processing databases - horizontally scaling databases:
- Distributed SQL
- Snowflake
- Google BigQuery TODO
- AWS Redshift TODO
See also the Hadoop Ecosystem section further down for more distributed SQL databases.
- Pub/Sub & Message Queues
- Kafka
- Celery
- for Kinesis see AWS
- Spark TODO
- Kafka
- Hadoop TODO
- Kerberos Hadoop TODO
- YARN TODO
- HDFS TODO
- Pig TODO
- Hive TODO
- Impala TODO
- Presto TODO
- Apache Drill TODO
- Kudu
- Kylin
- Storm TODO
- Mahout
- ZooKeeper
- Data Science TODO
- Python
- Anaconda TODO
- R TODO
- Octave TODO
- Security TODO
- SSL TODO
- Kerberos TODO
- FreeIPA TODO
- Keycloak
- Penetration Testing TODO
- Secrets Managers
- SOC - Security Operations Center
- Networking TODO
- VPNs
- Cisco TODO
- Juniper TODO
- Foundry TODO
- Keepalived
- Load Balancing TODO
- HAProxy
- F5
- Monitoring
- Nagios
- Prometheus TODO
- Thanos TODO
- Grafana TODO
- Notifications
- Fluentd
From my LinkedIn:
The rest of my original source repos are here.
Pre-built Docker images are available on my DockerHub.