Running the adc_test sketch and connecting A3 (breakout E/1) with 2V8 (C/5) with GND the value goes down from 1023 to zero.
This worked in my case also when the display was connected (but not in use). The touch pad is a i2c device so you should be able to use it simultainiously with the ADC.