The point of QoS is NOT to have the queues build up, not use all the bandwidth, so if you keep accepting packet at the maximum rate (and thus increasing latency for incoming packets), it's already to late to do shaping, the packets already arrive with a delay.
You can't control what packets are sent to you directly.