Is your DSO made by seeed, or is it a clone? (The ones made by seeed have “seeedstudio” logo on the back cover.)
It seems that there are some clones with 8MB flash memory of different type than the original DSO Quad. They require a special SYS revision, the normal .HEX files do not work.