2017-11-04 13:53:43 +00:00
# nebula
2018-01-01 03:30:46 +00:00
2017-12-25 13:07:25 +00:00
>Where stars are born.
2017-11-04 13:53:43 +00:00
2017-12-25 13:07:25 +00:00
Manages the local infrastructure of my home server. I'm also doing blog posts around the same:
1. [Part 1, Hardware ](https://captnemo.in/blog/2017/09/17/home-server-build/ )
2. [Part 2, Terraform/Docker ](https://captnemo.in/blog/2017/11/09/home-server-update/ )
2017-12-31 11:40:23 +00:00
3. [Part 3, Learnings ](https://captnemo.in/blog/2017/12/18/home-server-learnings/ )
4. [Part 4, Migrating from Google (and more) ](https://captnemo.in/blog/2017/12/31/migrating-from-google/ )
2017-11-04 13:53:43 +00:00
2017-12-26 17:54:37 +00:00
The canonical URL for this repo is https://git.captnemo.in/nemo/nebula/. A mirror is maintained on GitHub.
2017-11-04 13:53:43 +00:00
# modules
2018-02-17 20:46:56 +00:00
1. docker: to actually run the services. Catch-all for miscellaneous containers
2018-01-01 03:14:32 +00:00
2. cloudflare: to manage the DNS.
3. mysql: to create mysql users and databases.
2018-03-02 21:27:43 +00:00
4. media: Media related containers (Jackett, Lidarr, Radarr, Sonarr, Daapd)
2018-02-17 20:46:56 +00:00
5. Monitoring: Monitoring related resources (Cadvisor, Grafana, NodeExporter, Prometheus, Transmission-Exporter)
6. Gitea: Just git.captnemo.in
7. tt-rss: Tiny-Tiny RSS Web reader
8. Radicale: CardDav/CalDav webserver
2017-11-04 13:53:43 +00:00
2018-01-01 03:14:32 +00:00
Self-learning project for terraform/docker.
2017-11-04 14:30:42 +00:00
# Planned
2018-02-17 20:46:56 +00:00
1. ~Setup DigitalOcean~
2017-11-04 14:30:42 +00:00
2. Add DO infrastructure via ansible
2017-12-03 16:51:27 +00:00
3. ~Add traefik for proper proxying~
2018-01-01 03:14:32 +00:00
4. Maybe add docker swarm (or k8s?) across both the servers. Might setup the k8s API on the Raspberry Pi.
2017-11-29 20:14:05 +00:00
2018-01-01 03:14:32 +00:00
# Service List
Currently running the following (all links are to the `store.docker.com` links for the docker images that I'm using:
## Databases
- [MariaDB ](https://store.docker.com/images/mariadb ) for a simple database backend
- [MongoRocks ](https://store.docker.com/community/images/jadsonlourenco/mongo-rocks ) as a mongoDB server. Uses RocksDB as the backend
## Media
- [Emby ](https://store.docker.com/community/images/emby/embyserver ) Media Server
2018-02-17 20:46:56 +00:00
- [Radarr ](https://store.docker.com/community/images/linuxserver/radarr ), auto-download movies
- [Sonarr ](https://store.docker.com/community/images/linuxserver/sonarr ), auto-download TV Shows
2018-01-01 03:14:32 +00:00
- [Transmission ](https://store.docker.com/community/images/linuxserver/transmission ), to download torrents
2018-03-30 18:54:03 +00:00
- [Heimdall ](https://store.docker.com/community/images/linuxserver/heimdall ), for a single link to other services
2018-01-01 03:14:32 +00:00
- [AirSonic ](https://store.docker.com/community/images/airsonic/airsonic ), for a music server
- [Ubooquity ](https://store.docker.com/community/images/linuxserver/ubooquity ), EBooks server with OPDS support
- [Lychee ](https://store.docker.com/community/images/linuxserver/lychee ), as a simple image-sharing/hosting service
2018-03-30 18:54:03 +00:00
## Plumbing & Monitoring
2018-01-01 03:14:32 +00:00
2018-03-30 18:54:03 +00:00
- [Traefik ](https://store.docker.com/images/traefik ) as a reverse-proxy server, and TLS termination.
- [CAdvisor ](https://store.docker.com/community/images/google/cadvisor ), for basic monitoring. Reports metrics to prometheus
- [Grafana ](https://store.docker.com/community/images/grafana/grafana ), for graphing. Public at < https: // grafana . bb8 . fun >
- [Prometheus ](https://store.docker.com/community/images/prom/prometheus ), for metrics.
- [Nodeexporter ](https://store.docker.com/community/images/prom/node-exporter ), for host-metrics.
2018-01-01 03:14:32 +00:00
## Misc
2018-03-30 18:54:03 +00:00
- [Wiki.JS ](https://store.docker.com/community/images/requarks/wiki ) as a simple home-wiki. Public at < https: // wiki . bb8 . fun >
2018-01-01 03:14:32 +00:00
- [Radicale ](https://store.docker.com/community/images/tomsquest/docker-radicale ), for a CalDav/Carddav server
2018-03-30 18:54:03 +00:00
- [Gitea ](https://store.docker.com/community/images/gitea/gitea ), git server. Public at < https: // git . captnemo . in >
- [Timemachine ](https://store.docker.com/community/images/odarriba/timemachine ) to take backups of a few macbooks.
- [Resilio Sync ](https://store.docker.com/community/images/linuxserver/resilio-sync ) as a dropbox alternative
- [tt-rss ](https://store.docker.com/community/images/linuxserver/tt-rss ), as a simple web-rss-client
2018-01-01 03:14:32 +00:00
2018-03-30 18:54:03 +00:00
## Docker Notes
- Lots of the above images are from the excellent [LinuxServer.io ](https://www.linuxserver.io ), and they're doing great work :+1:
- Most images are running the latest beta (if available) or stable versions.
- Traefik is running with wildcard certificates.
2017-11-30 20:49:35 +00:00
2017-12-03 16:51:27 +00:00
## Upstream
Issues I've faced/reported as a result of this project:
2018-03-30 18:54:03 +00:00
1. Airsonic HTTPS proxying is broken. Reported: https://github.com/airsonic/airsonic/issues/641. Turned out to be a known issue: https://github.com/airsonic/airsonic/issues/594. Now fixed.
2. Traefik docker backend security headers were broken with dashes. I [reported it here ](https://github.com/containous/traefik/issues/2493 ), and fixed by https://github.com/containous/traefik/pull/2496 :white_check_mark:
2018-03-07 19:12:42 +00:00
3. Headphones dies repeatedly with no error logs. Yet-to-report. (Already reported, fails due to classical artists)
2018-03-30 18:54:03 +00:00
4. Terraform doesn't parse mariadb version numbers. Report: https://github.com/terraform-providers/terraform-provider-mysql/issues/6. Filed a [PR to fix ](https://github.com/hashicorp/go-version/pull/34 ) and [to bump the go-version dependency ](https://github.com/terraform-providers/terraform-provider-mysql/pull/27 ) :white_check_mark:
5. `elibsrv` didn't support ebook-convert, only mobigen. PR is at https://github.com/captn3m0/elibsrv/pull/1. Merged to `elibsrv` trunk, will be part of next release.
2017-12-26 17:59:08 +00:00
6. `ubooquity` docker container doesn't let you set admin password: https://github.com/linuxserver/docker-ubooquity/issues/17. (Couldn't reproduce, closed) :white_check_mark:
7. Traefik customresponseheaders can't contain colons on the docker backend: https://github.com/containous/traefik/issues/2517. Fixed with https://github.com/containous/traefik/pull/2509 :white_check_mark:
2017-12-25 13:11:02 +00:00
8. Traefik Security headers don't overwrite upstream headers: https://github.com/containous/traefik/issues/2618
2018-03-30 18:54:03 +00:00
9. Transmission exporter broke with different data types while unmarshalling JSON in go. I filed a PR https://github.com/metalmatze/transmission-exporter/pull/2.
10. Radarr official docker container was [running a very old `mediainfo` ](https://github.com/Radarr/Radarr/issues/2668#issuecomment-376310514 ). [Filed a fix to upgrade `mediainfo` on the official radarr image ](https://github.com/linuxserver/docker-baseimage-mono/pull/3 )
2017-12-03 21:13:50 +00:00
# Plumbing
Their is a lot of additional infrastructure that is _not-yet_ part of this repo. This includes:
1. The Digital Ocean droplet running DNSCrypt and simpleproxy to proxy over a openvpn connection to this box.
2. openbox, kodi configuration to run on boot along with the Steam Controller for the HTPC setup
3. Docker main configuration with half-baked CA setup
4. btrfs-backed subvolumes and snapshotting for most things in /mnt/xwing/ (in-progress)
2018-01-01 03:14:32 +00:00
5. User-creation on the main server. (I'm using a common user for media applications and specific users for other applications)
# License
All code in this repository is shared under the [MIT License ](https://nemo.mit-license.org/ ).
