Sort:  

@mctiller, I do the same thing sometime as well!

Step 1) Write automated response to some post
Step 2) Check if original author responded to step 1 message
Step 3) If yes check for a ? (has the author posted a question to the automated response?)
Step 4) If yes send the human to convince the author

90% of the work done :P