As a reference, when using the common play structure you can extend the timeout. There may be a similar method to delay the processing of the fallback skill while you retrieve your answers.
Here is some info on extending for the common play. @gez-mycroft or @forslund may know if this can be done for other skills as well.