What did Johnny announce after his fifth barbecue sandwich?

In chapter 6, Dally visits Ponyboy and Johnny in Windrixville and takes them out to eat at Dairy Queen. The boys are famished and end up stuffing themselves with BBQ sandwiches as Dally tells them about what is happening back at home. After Johnny finishes his fifth BBQ sandwich, he shocks Dally and Ponyboy by saying,

"We're goin' back and turn ourselves in" (Hinton, 74).

Dally reacts by gagging on his food before he curses at Johnny. Johnny proceeds to tell Dally and Pony that he believes he has a good chance of getting let off easy because he has no prior record with the police and was acting in self-defense. Johnny also mentions that he does not plan on spending the rest of his life in the abandoned church and simply wishes to go back home. Following Johnny's speech, Dally expresses his displeasure with Johnny's decision to turn himself in by telling Johnny that he doesn't want him to get hardened in jail like he did when he was first incarcerated. Shortly after leaving Dairy Queen, the boys arrive at the abandoned church and discover that it is on fire. When Pony learns that there are children trapped inside the church, he courageously enters the burning building and Johnny follows him inside.