Ability to edit customs fields on the fly (with an inline or hover over edit button)

I edit my custom fields regularly and it is a pain to constantly go in to and edit the record, then scroll to contact info section, then find the field and edit it.

If there is an edit button on each field, this would be very helpful.

Thanks!