Longtime Berkshire Hathaway Director Ronald Olson will be leaving its board because of a policy change requiring directors, except for Warren Buffett, to step down after turning 80.