Restart button that appears under list of installed plugins after plugin
upload does not restart jenkins when clicked.

More than that, after turning on/off some of installed plugins,
two restart buttons appear (only one of them work) on the page in
question.

Such behaviour should definitely be fixed.