Remove some GUI items that we are not going to use:

sudo apt-get remove dbus x11-common midori lxde python3 python3-minimal lxde-common lxde-icon-theme omxplayer raspi-config
sudo apt-get remove `sudo dpkg --get-selections | grep -v "deinstall" | grep x11 | sed s/install//`

These are a big resource hog.

You also need to edit a boot file to slow down the USB hub so packets do not clash:

nano /boot/cmdline.txt

Add these two lines

dwc_otc.speed=1
smsc95xx.turbo_mode=N

The first one puts the USB hub into 1.1 mode. the second slows down the usb side of the network.