Macbeth and Banquo are trying to remember exactly what the witches said. When Macbeth asks, “Went it not so?”, that expression reminds Banquo of what one might say in a pub when trying to remember a song. He jokingly responds accordingly.