inference: remove 'allow_empty' option

4 jobs for master in 622 minutes and 14 seconds (queued for 4 seconds)