John Albietz
Consulting DevOps Architect
John Albietz
Consulting DevOps Architect
San Francisco Bay Area
Overview
Work Experience
Consulting DevOps Architect
2019 - Current
Work as a Consulting DevOps Architect implementing solutions for complex DevOps projects. Selected Recent Projects: • Cloud Cost Optimization (FinOps) resulting in over $10MM savings in annual AWS costs • Cryptocurrency testnet / mainnet architecture and setup using Kubernetes on Google Cloud (GCP / GKE) • Migration from Elastic Beanstalk to Kubernetes with KOPS • Kubernetes tuning, auto-scaling and cost-optimization • Migration from SAAS metrics to Prometheus with Grafana. • Migration from AWS to Google Cloud • GDPR Compliance Auditing and Implementation • Architecture and setup of secure multi-environment AWS infrastructure using Terraform • Multi-environment automation using Ansible and SaltStack • Immutable Server CI Pipeline using Packer & Jenkins • Setup, Tuning and Management of Elasticsearch, Consul, Hadoop, multi-datacenter Cassandra clusters. • Management & Optimization of multiplayer game servers. • Implementing CD using Saltstack, ALBs and AWS auto-scaling groups Some of my favorite technologies I've been working with: Kubernetes, Helm, Argo, Istio, Docker, Prometheus, Saltstack, Ansible, Kibana, Grafana, Terraform.
DevOps Architect
2017 - 2019
Responsible for: • Overall responsibility for the uptime, reliability and security of Ampush's internal and client-facing systems. • Managed a team of Devops engineers with 24/7 oncall responsibility. • Implemented monitoring and alerting systems to meet 99.95% uptime and performance SLAs • Implemented and maintained Docker-based microservice architecture • Developed and tested Disaster Recovery automation and plans • Cost management for a significant AWS footprint. • Upgrading and patching servers, applications and databases to latest stable versions with zero downtime. Main infrastructure components: • Terraform, Docker, Cassandra, Elasticsearch, Consul, Packer, AWS
Co-Founder & CTO
2015 - 2017
One More Cloud (OMC) is one of the world's largest managed search providers, and the company behind bonsai.io and websolr.com . I was overall responsible for the uptime, stability and performance of our managed Elasticsearch and Solr products, and directly responsible for managing a massive fleet of Elasticsearch and Solr infrastructure running on Amazon Web Services, as well as all the related DevOps, Security, Compliance, Cost Optimization and Infrastructure efforts.
Consulting DevOps Architect
2013 - 2015
Work as a Consulting DevOps Architect with companies in the SF Bay Area. Specializing in: • Setup and optimization of Continuous Integration and Continuous Deploy systems. • Setup and optimization of centralized logging and alerting systems • Automation of developer / devops flows to maximize developer productivity • Migration of legacy monolithic systems from bare-metal to LXC/Docker architecture. • Setup and integration of fraud detection and alerting systems • Architecture / Security infrastructure audits Some of my favorite technologies I've been recently working with: Kubernetes, Mesos, Docker, Hive, Shark, Spark, Solr, Storm, Jenkins, Ubuntu, Debian, ZFS, Logstash, Elasticsearch, Kibana, Saltstack, Ansible, Grafana, Riemann, Influxdb, Rabbitmq, Kafka. Selected Recent Projects: • Highly-Scalable analytics stack using influxdb/heka/kafka/rabbitmq/docker • Dev Environment + cloud controller using vagrant/docker/saltstack/aws/virtualbox/vmware • Highly optimized self-managing ELKstack including latest Kibana • Migration from Heroku to optimized Docker/AWS setup. • Hosted image bakery using Packer and other OSS tools. • HA/Secure SIEM implementation using OSS tools. • Fraud & Anomalous Activity Detection & Alerting • Docker in Production (PCI and FINRA compliant) Configuration Management, DevOps, TechOps, DbOps, System Architecture, Scalability Engineering, System Engineering, Automation Engineering, SaltStack, Network Security, Linux Security, Secure System Architecture and IT
Director of DevOps & SRE
2013 - 2013
Worked directly with the CEO to lead and manage the DevOps, Security, Compliance and Infrastructure teams at Clinkle. I recruited, hired and managed a team of world-class Sr. TechOps generalists with expertise in the following areas: DevOps System Automation, Encryption, Databases & Big Data Systems, Fraud Systems, Analytics Systems, Enterprise IT, Build & Release Engineering, PCI Compliance, Logging & Alerting, App & Network Security and Security Response. Responsible for: • Configuration Management using Ansible and Saltstack • Scala (Java) and Rails application management • HA and Secure System Architecture • HA Database setup and management using Percona Xtradb Cluster • Hybrid-cloud design using AWS and On-premises datacenter • Big Data Analytics using Spark, HDFS & Hadoop • Logging infrastructure using Elasticsearch, Kibana, Logstash & Hekad • Monitoring and alerting using Nagios and ELKstack. • Managing 3rd party security audits and architectural reviews * Leading all PCI compliance efforts. * Fraud, insider-threat and money-laundering mitigation efforts.
DevOps Architect
2012 - 2013
Worked with the the COO to architect and build Versal's Technical Operations DevOps infrastructure and DevOps team from the ground up. Helped create and establish DevOps and system automation best practices within a well-funded and rapidly growing startup with complex technical needs. Responsible for: * Scala and Nodejs application deployment * Configuration Management using Saltstack * Continuous Integration using Jenkins * Test/Build Automation using Artifactory and Nexus * HA System Architecture * Hybrid multi-cloud design using AWS and OpenStack Grizzly * TDD Devops. * HA Database setup and management using Percona Xtradb Cluster * System monitoring and alerting using Logstash / Hekad / Elasticsearch / Pagerduty * Big data analytics using Hbase / Hadoop
Senior DevOps Engineer
2012 - 2012
The first DevOps engineering hire at Chartboost, I was responsible for the health, optimization and architecture of the Chartboost API, website & backend systems. Moved Chartboost from Amazon AWS to a hybrid-cloud and multi-cloud architecture, achieving 99.99% uptime, 5x performance improvement and 60% reduction in per-transaction costs. As part of these efforts, I re-architected and optimized their systems to handle their more than 6x traffic growth to well beyond 4 Billion game sessions/month. Common tasks include working on: * Third-party IT/CDN vendor selection and management * Amazon Web Services Infrastructure Optimization: EC2 / S3 / Route53 / IAP / Elasticache / SQS / SNS / Cloudfront * HA Cloud App architecture, implementation & automation using API and Dashboard tools * Technical Operations infrastructure capacity planning & management * SaltStack package management and remote execution environment setup, configuration & module development * IOS & Android SDK monitoring * App Deployment, Testing & Automation * Monitoring, Logging & Alerting using Cloudwatch / ServerDensity / Mongo MMS / Ylastic / Skydera C3 / Scribe / Scout / Flume / Pagerduty * Low-Level Linux kernel configuration and optimization * Application Level Server Config & Automation * Git Repo management and git-based code deployment architecture setup. * Creating & Modifying Shell Scripts using Python, Bash, Ruby & PHP. * Nginx, PHP-FPM, Python Tornado, Java, Apache & HAProxy Configuration & Optimization * MongoDB/Vertica/MySQL/Percona/Couchbase/Memcache setup & performance optimization * Big-data (multiple billion-row) database architecture design, implementation and performance optimization using MongoDB and EMR/Hadoop/HDFS. * Critical Office IT & Security Issues, primarily using Apple consumer and enterprise products.
Senior DevOps Engineer
2006 - 2012
• Experienced in installation, setup, configuration, maintenance & troubleshooting on Red Hat Enterprise Linux, CentOS, Ubuntu Linux, Mac OSX, iOS, Lumiere (Open Solaris), Windows platforms. • Hands on installation & administration of application services: Apache, NGINX, Mongrel, Unicorn, Apache Tomcat, Memcached, Solr/Lucene, Sphinx, MySQL, PostgreSQL, MongoDB, APC, FTP, Mail (SMTP, POP3), Samba • High Availability Cloud system architecture and implementation using Puppet, Capistrano, Fabric, Kickstart, Rightscale, Scalr & custom scripts • Commercial IAAS cloud provider expertise: Amazon Web Services (EC2, S3, etc.), Linode, Slicehost, Rackspace Cloud Servers, Joyent • Responsible for 100% uptime for all hardware and applications in 24/7 environment. 24-hour on-call availability. • Planned, installed & supported high availability applications, business persistence & failover using Linux Tools. • Managed 3rd party CDN’s: Akamai, Lightstream, MaxCDN, FlyCDN, Amazon CloudFront, Rackspace Cloud Files. Developed Custom Origin-pull Content Distribution Network. • Installed and managed Ad Platforms including Google Adsense, Google Ad Manager, DART for publishing. • Customized installations of web analytics software including Google Analytics, Woopra & Chartbeat. • Implemented and enhanced Unix Shell Scripts • Developed and implemented security procedures for Linux Servers: ids/ips, iptables • MySQL 5.X / MariaDB / Percona db server installation, configuration, monitoring, backup, query optimization & performance tuning. • Installed & customized Performance Monitoring and Notification Systems for servers and databases: Nagios, Cacti, NewRelic, Ganglia • Volume/Disk Management and Software RAID implementation using Linux, Mac & Window tools. • Effective communication skills developed through continuous interaction with global clients and management of product development teams.