In the Chart Options section of the sidebar, select the Border checkbox.
To add a background color to the chart or choose a style and color for the border, click the disclosure arrow next to Background & Border Style, then use the controls in that section.