People travelled from places such as Shepparton, Albury, Wangaratta, Mansfield, Yackandandah, Swanpool and Euroa to show their support.
The event was part of a National Day of Action, with protest events held in 28 cities and regional towns across Australia.
Organisers of the protests say Israel has long oppressed Palestinians in Gaza, the West Bank and East Jerusalem.
“Violent attacks by the Israeli military causing civilian deaths and injuries, arrests without trial, forceful taking of farms, demolition of homes, hospitals and civilian infrastructure have been common for decades, but are now escalating,” event organiser Hamish McPherson said.
“Since Hamas killed 1671 Israelis and foreign nationals and took 240 civilians hostage in October 2023, Israel has imposed collective punishment on the entire civilian population of Gaza.”
Mr Herzog has been the head of the Israeli state since 2021.
Protest organisers say the Israeli military campaign has caused 71,662 civilian deaths, 1.9 million people being displaced, the killing of 1700 healthcare workers and 248 journalists, and over 80 per cent of homes, hospitals and schools in Gaza damaged or destroyed.
“We can't ignore the terrible suffering that has been inflicted on the people of Gaza by the Israeli government,” Mr McPherson said.
“President Herzog should be arrested and investigated for war crimes, not given an official welcome.
“The Australian Government should impose sanctions on Israel to oppose their unlawful occupation and ongoing genocide against the Palestinian people.”
Fellow organiser Rhona Rose said those at the gatherings were standing up for human rights both in Palestine and in Australia.
“We oppose anti-Semitism and all forms of racism,” she said.
“We need to build understanding and social cohesion based on genuine human rights and justice for all.
“As part of a global, peaceful movement, we will continue to advocate and press for an end to Israel’s unlawful occupation and the oppression of the Palestinian people.”