It was not unfair or unreasonable to rely on a single source before allegedly defaming the head of a large Aboriginal land council over a vote of dismissal, an outspoken Liberal senator says.