Rachel's Yard

| A New Continuation
Tags Intel NUC

Details coming soon. Basically, Intel NUC sucks when running OpenStack hypervisor. I revised my setup a bit:

Compute node (currently only one):

  • Morex 557 case
  • Noctua NH-L9i
  • ASRock E3C224D2I
  • Xeon E3-1230V3
  • Crucial DDR3 1600 2x8GB ECC
  • picoPSU 160-XT

Controller node:

  • Silverstone PT13 thin mini-itx
  • Gigabyte GA-Q87TN (Intel NIC running public traffic, Realtek NIC running VM traffic)
  • Core i3-4130T
  • Dynatron T459 (28mm height, damn)
  • Crucial SODIMM DDR3 1600 2x8GB non-ECC
  • ADATA SP310 32GB boot
  • Samsung 840 EVO 120GB data (MySQL, blah blah) Maybe I will change it via iSCSI in the future

Storage node:

  • Norco RPC-2008
  • ASRock E3C224-4L (ASRock can suck my ass, EVERY BOARD I bought from them requires at least one RMA. Yep, this one as well. Newegg fucks ass as well) (Because Quad LAN teaming is too mainstream)
  • 8x1TB Hitachi (yep, the ORIGINAL Hitachi drive, manufactured in 2011) 7200rpm SATA II
  • Xeon E3-1220V3 (maybe a better cooler than the stock one)
  • Crucial DDR 1600 4x8GB ECC
  • Plextor m6e PCIe 128GB SSD as boot drive and ZIL

You may wonder, where's the disk on the compute node? Glad that you wondered. All compute nodes will be booting from PXE + TFTP + iSCSI root. It is working without the damn storage node (running on Controller as proof of concept)

My original plan was to buy a small yet powerful server to run pfSense, so I can put it in my cabinet to act as firewall. Well that plan went well. I bought an Intel NUC with i3-4010U no 2.5", and a TP-LINK TL-SG2216. Since the Intel NUC has only one NIC, VLAN tagging is the way to go. Aka router on a stick:

Router on a stick -Source

Well it works really well. Since Hurricane Electric only gave me 100Mbps, so there is (in theory) no bottleneck (yet).

Then....I stumbled upon this: http://www.virten.net/2013/12/vmware-vsphere-homeserver-homelab-esxi-on-4th-gen-intel-nuc/

So I was thinking, how about I go the extra miles? Here it goes, running OpenStack on NUC. Fully featured.


The left most one is running pfSense router-on-a-stick, i3-4010U, 8GB of Crucial ram, and a MyDigitalSSD SC2 32GB.

The middle three are the Compute Nodes. Each has a i3-4010U, 2x8GB of Crucial sticks except the top one, the top NUC has Patriot Viper ram because Crucial is out of stock for some reasons. Each is running ADATA Premier Pro SP310 32GB mSATA just enough to boot. I plan to have 3 more SanDisk X110 2.5" to host the instance images and/or configuration files since the SP310 has a SLOW write speed.

Power Consumption

The Controller Node with Xeon idles around 22W, NUC idles around 10W

The Controller Node on the right, a bigger box. It has a ASRock E3C224D2I, a Xeon E3-1220 V3, a single 8GB ECC DIMM because the Storage Node needs a DIMM, which we will talk about it later. The Controller Node is running the essential OpenStack services (Keystone, Horizon, etc) and nova-network (because Neutron is broken as fuck). It has a Samsung 840 EVO 120GB. The case is a Mini-Box M350, with a picoPSU-160-xt. Powering it with a 144W AC-DC brick.

The nova-network setup is inspired by https://www.mirantis.com/blog/openstack-networking-single-host-flatdhcpmanager/


For Storage, we have a Supermicro bare bone running a Intel Atom C2550. Running on a single 8GB DIMM ECC stolen from the Controller Node. I have a 8GBx4 coming so it will be fine. For Cinder and Glance, the storage is on ZFS-backed RAID 10. 4x500GB 2.5" 7200rpm from HGST. System and ZIL are on a Plextor m6E PCI-E SSD.


For switch, we have this:

  • Port 15, WAN, VLAN 10 untagged, VPID 10
  • Port 16, pfSense, VLAN 10 tagged, VLAN 20 tagged, VPID 10
  • Port 14/13 LACP, Controller Node, VLAN 20 tagged, VLAN 30 tagged, VPID 20
  • Port 12/11 LACP, Storage Node, VLAN 20 tagged, VPID 20
  • Port 3-8, Compute Nodes, VLAN 20 tagged, VLAN 30 tagged, VPID 20



Weightless Theme
Rocking Basscss