Source Code for the Home Server setup. This includes the git server hosting this repository as well. #terraform #docker https://git.captnemo.in/nemo/nebula/
Nemo 840ce49e98 radicale: Migrate to container module 5 hours ago
_scripts Upgrades and stuff 2 months ago
abstruse Create and use a single traefik network everywhere 2 months ago
cloudflare Adds a new domain and KIB 4 months ago
db Temp fix since networks aren't editable 5 hours ago
digitalocean Make link dependencies explicit 6 months ago
docker Cleaner module for web configuration 2 weeks ago
gitea Gitea, miniflux upgrades 1 month ago
media Migrate radarr to volumes 5 hours ago
modules rss-bridge: Migrate to container module 5 hours ago
monitoring Switch prometheus port 1 month ago
opml opml: Migrate to container module 5 hours ago
radicale radicale: Migrate to container module 5 hours ago
resilio Create and use a single traefik network everywhere 2 months ago
timemachine standardize quotes on resource type 4 months ago
.editorconfig Work on proxying content via sydney 8 months ago
.gitignore Work on proxying content via sydney 8 months ago
README.md Drops tt-rss entirely 3 weeks ago
echoserver.tf Minor fixes in container zipmapping 2 weeks ago
heimdall.tf Really complicated terraform labelling 2 weeks ago
main.tf radicale: Migrate to container module 5 hours ago
miniflux.tf Really complicated terraform labelling 2 weeks ago
monicahq.tf Cleaner module for web configuration 2 weeks ago
providers.tf Starting to drop mariadb 1 month ago
requestbin.tf Minor fixes in container zipmapping 2 weeks ago
rss-bridge.tf rss-bridge: Migrate to container module 5 hours ago
variables.tf Creates a generic docker-container module 3 weeks ago

README.md

nebula

Nebula header image

Where stars are born.

Manages the local infrastructure of my home server. I’m also doing blog posts around the same:

  1. Part 1, Hardware
  2. Part 2, Terraform/Docker
  3. Part 3, Learnings
  4. Part 4, Migrating from Google (and more)
  5. Part 5, Networking

The canonical URL for this repo is https://git.captnemo.in/nemo/nebula/. A mirror is maintained on GitHub at https://github.com/captn3m0/nebula

modules

  1. docker: to actually run the services. Catch-all for miscellaneous containers
  2. cloudflare: to manage the DNS.
  3. mysql: to create mysql users and databases.
  4. media: Media related containers (Jackett, Lidarr, Radarr, Sonarr)
  5. Monitoring: Monitoring related resources (Cadvisor, Grafana, NodeExporter, Prometheus, Transmission-Exporter)
  6. Gitea: Just git.captnemo.in
  7. miniflux: RSS Web reader
  8. Radicale: CardDav/CalDav webserver

Self-learning project for terraform/docker.

Planned

  1. ~Setup DigitalOcean~
  2. Add DO infrastructure via ansible
  3. ~Add traefik for proper proxying~
  4. Maybe add docker swarm (or k8s?) across both the servers. Might setup the k8s API on the Raspberry Pi.

Service List

Currently running the following (all links are to the store.docker.com links for the docker images that I’m using:

image tag module/link
bleenco/abstruse latest ci
captn3m0/opml-gen latest https://opml.bb8.fun
captn3m0/prometheus-act-exporter latest https://git.captnemo.in/nemo/prometheus-act-exporter
captn3m0/rss-bridge latest https://github.com/RSS-Bridge/rss-bridge
captn3m0/speedtest-exporter alpine https://github.com/stefanwalther/speedtest-exporter
emby/embyserver latest https://emby.media
gitea/gitea 1.5.0-rc1 services
google/cadvisor latest monitoring
grafana/grafana latest monitoring
jankysolutions/requestbin latest tools
linuxserver/airsonic latest media
linuxserver/heimdall latest tools
linuxserver/jackett latest media
linuxserver/lidarr latest media
linuxserver/lychee latest media
linuxserver/radarr latest media
linuxserver/resilio-sync latest sync
linuxserver/sonarr latest media
linuxserver/transmission latest media
linuxserver/ubooquity latest media
miniflux/miniflux 2.0.9 tools
monicahq/monicahq latest services
odarriba/timemachine latest tools
percona/percona-server-mongodb 3.4 database
postgres 10-alpine database
prom/node-exporter v0.15.2 monitoring
prom/prometheus latest monitoring
requarks/wiki latest services
serjs/go-socks5-proxy latest tools
tocttou/gotviz latest na
tomsquest/docker-radicale latest services
traefik 1.6-alpine plumbing

Docker Notes

  • Lots of the above images are from the excellent LinuxServer.io, and they’re doing great work :+1:
  • Most images are running the latest beta (if available) or stable versions.
  • Traefik is running with wildcard certificates.

Upstream

I’ve been using this as a contributing opportunity and reporting/fixing issues upstream:

  1. Airsonic HTTPS proxying is broken. Reported: https://github.com/airsonic/airsonic/issues/641. Turned out to be a known issue: https://github.com/airsonic/airsonic/issues/594. Now fixed.
  2. Traefik docker backend security headers were broken with dashes. I reported it here, and fixed by https://github.com/containous/traefik/pull/2496 :white_check_mark:
  3. Headphones dies repeatedly with no error logs. Yet-to-report. (Already reported, fails due to classical artists)
  4. Terraform doesn’t parse mariadb version numbers. Report: https://github.com/terraform-providers/terraform-provider-mysql/issues/6. Filed a PR to fix and to bump the go-version dependency :white_check_mark:
  5. elibsrv didn’t support ebook-convert, only mobigen. PR is at https://github.com/captn3m0/elibsrv/pull/1. Merged to elibsrv trunk, will be part of next release.
  6. ubooquity docker container doesn’t let you set admin password: https://github.com/linuxserver/docker-ubooquity/issues/17. (Couldn’t reproduce, closed) :white_check_mark:
  7. Traefik customresponseheaders can’t contain colons on the docker backend: https://github.com/containous/traefik/issues/2517. Fixed with https://github.com/containous/traefik/pull/2509 :white_check_mark:
  8. Traefik Security headers don’t overwrite upstream headers: https://github.com/containous/traefik/issues/2618 :white_check_mark:
  9. Transmission exporter broke with different data types while unmarshalling JSON in go. I filed a PR https://github.com/metalmatze/transmission-exporter/pull/2 :white_check_mark:
  10. Radarr official docker container was running a very old mediainfo. Filed a fix to upgrade mediainfo on the official radarr image :white_check_mark:
  11. Patched the speedtest-exporter to use Alpine and upgraded Node.JS for a smaller updated build.
  12. Faced (4) above again because mariadb decided to add : in the version response. Workaround was to force set --version=10.3-mariadb
  13. Reported 2 critical security issues in Abstruse CI. :white_check_mark:
  14. Faced (13) above again with postgres, thankfully someone already fixed version parsing :white_check_mark:
  15. RSS Bridge was missing an official Docker Image. I Filed a PR :white_check_mark:

Plumbing

Their is a lot of additional infrastructure that is not-yet part of this repo. This includes:

  1. The Digital Ocean droplet running DNSCrypt and simpleproxy to proxy over a openvpn connection to this box.
  2. openbox, kodi configuration to run on boot along with the Steam Controller for the HTPC setup
  3. Docker main configuration with half-baked CA setup
  4. btrfs-backed subvolumes and snapshotting for most things in /mnt/xwing/ (in-progress)
  5. User-creation on the main server. (I’m using a common user for media applications and specific users for other applications)

License

All code in this repository is shared under the MIT License.