WordPress.org

Make WordPress Core

Opened 9 years ago

Last modified 3 years ago

#20564 assigned enhancement

Framework for storing revisions of Post Meta

Reported by: alexkingorg Owned by: adamsilverstein
Milestone: Future Release Priority: normal
Severity: normal Version: 3.4
Component: Revisions Keywords: dev-feedback
Focuses: Cc:

Description

There are a couple of tickets that would seem to benefit from storing revisions of post meta (#11049, #20299). We had a need for this feature in our Carrington Build and RAMP products and built it a few years back.

It handles the storing of post meta along with revisions, as well as restoring those revisions when someone restores an older version of a post(/page/etc.). There is an API for registering the post meta keys you want to track revisions of, it does not track all post meta keys by default.

There are two versions of the code. The bare-bones revisions framework code is here:

https://github.com/crowdfavorite/wp-revision-manager
https://github.com/crowdfavorite/wp-revision-manager/blob/master/cf-revision-manager.php

while I started adding features to a version that would be more user-friendly plugin, allowing the users to select which post meta keys they want to track revisions for:

http://plugins.svn.wordpress.org/revision-manager/
http://plugins.svn.wordpress.org/revision-manager/trunk/cf-revision-manager.php

If this would be a valuable addition to core, I'd be happy to help polish this up in whatever manner is most helpful. I'd recommend breaking out the code I started on for the admin form and having that be the extent of the "revision manager" plugin - basically it becomes a nicer UI for selecting additional post meta keys to track revisions for.

Attachments (38)

20564.diff (5.8 KB) - added by adamsilverstein 9 years ago.
20564+16215.diff (24.3 KB) - added by adamsilverstein 9 years ago.
for testing
20564.2.diff (5.5 KB) - added by adamsilverstein 9 years ago.
updated against current trunk
20564.3.diff (5.5 KB) - added by adamsilverstein 9 years ago.
update against current
20564.4.patch (3.5 KB) - added by WraithKenny 9 years ago.
20564.5.patch (4.5 KB) - added by WraithKenny 9 years ago.
20564.4.diff (4.2 KB) - added by kovshenin 9 years ago.
20564.5.diff (2.5 KB) - added by kovshenin 9 years ago.
20564-6.patch (8.3 KB) - added by azaozz 9 years ago.
20564.6.diff (3.8 KB) - added by kovshenin 9 years ago.
20564.7.diff (4.0 KB) - added by kovshenin 8 years ago.
20564-8.patch (6.3 KB) - added by azaozz 8 years ago.
20564-9.patch (7.0 KB) - added by adamsilverstein 8 years ago.
reintroduce changes removed in 24397
20564-10.diff (11.7 KB) - added by adamsilverstein 8 years ago.
includes unit test
20564-11.diff (11.0 KB) - added by adamsilverstein 8 years ago.
remove unused post format meta values from default array and tests
20564-12.diff (11.1 KB) - added by adamsilverstein 8 years ago.
slight test cleanup
20564-13.diff (11.3 KB) - added by adamsilverstein 8 years ago.
20564-14.diff (9.1 KB) - added by adamsilverstein 8 years ago.
remove post format revisioning
20564.8.diff (9.9 KB) - added by DrewAPicture 8 years ago.
+ docs fixes
20564.9.diff (10.7 KB) - added by adamsilverstein 8 years ago.
Refresh against trunk. remove redundant restore block; update unit tests
20564.10.diff (11.2 KB) - added by adamsilverstein 8 years ago.
add wp_unslash to $_POST comparison
20564-autosave-data.png (148.4 KB) - added by TV productions 8 years ago.
The data that an autosave sent in wp 3.9-alpha-27445-src
20564.11.diff (11.2 KB) - added by adamsilverstein 8 years ago.
Refresh against trunk
20564.12.diff (9.9 KB) - added by adamsilverstein 7 years ago.
refresh against trunk
20564.13.diff (10.3 KB) - added by adamsilverstein 7 years ago.
refresh against trunk
20564.14.diff (12.9 KB) - added by adamsilverstein 7 years ago.
only save changed revisions
20564.15.diff (11.3 KB) - added by adamsilverstein 7 years ago.
don't save blank meta, track revisioned keys
20564.16.diff (12.0 KB) - added by adamsilverstein 7 years ago.
update unit test, restore revision with untracked key
20564.17.diff (12.9 KB) - added by adamsilverstein 7 years ago.
account for the storing of multiple values per key
20564.18.diff (12.9 KB) - added by adamsilverstein 7 years ago.
refresh against trunk
20564.19.diff (12.9 KB) - added by adamsilverstein 7 years ago.
refresh
20564-new-action.diff (537 bytes) - added by adamsilverstein 7 years ago.
hook for autosave
20564-new-action.2.diff (530 bytes) - added by adamsilverstein 7 years ago.
pass entire $new_autosave array
20564.20.diff (7.8 KB) - added by adamsilverstein 7 years ago.
add one filter, unit tests
20564.21.diff (8.2 KB) - added by adamsilverstein 7 years ago.
Adds hook docs
30033.diff (739 bytes) - added by mattheu 7 years ago.
20564.22.diff (8.7 KB) - added by mattheu 7 years ago.
20564.23.diff (2.3 KB) - added by mattheu 7 years ago.

Download all attachments as: .zip

Change History (175)

#1 @scribu
9 years ago

  • Cc scribu added

#2 @toscho
9 years ago

  • Cc info@… added

#3 @rspindel
9 years ago

  • Cc rspindel added

#4 @jkudish
9 years ago

  • Cc joachim.kudish@… added

#5 @Ipstenu
9 years ago

  • Cc ipstenu@… added

#6 @kovshenin
9 years ago

  • Cc kovshenin@… added

#7 @hameedullah
9 years ago

  • Cc h@… added

#8 @ryanduff
9 years ago

  • Cc ryan@… added

#9 @maor
9 years ago

  • Cc maorhaz@… added

#10 @travisnorthcutt
9 years ago

  • Cc travis@… added

#11 @sc0ttkclark
9 years ago

  • Cc lol@… added

#12 @xyzzy
9 years ago

  • Cc dennen@… added

#13 @lightningspirit
9 years ago

  • Cc lightningspirit@… added

+1

#14 @swissspidy
9 years ago

  • Cc hello@… added

#15 @sennza
9 years ago

  • Cc bronson@… added

#16 @jaredatch
9 years ago

  • Cc jared@… added

#17 @bainternet
9 years ago

  • Cc admin@… added

#18 @jb510
9 years ago

  • Cc jbrown510@… added

#19 follow-up: @nacin
9 years ago

  • Milestone changed from Awaiting Review to 3.6

This and #20299 would block #23314.

#20 @johnbillion
9 years ago

This and #20299 also potentially block the no-JS fallback for #19570, although MarkJaquith mentioned the possibility of not allowing a post to switch formats after the fact if you have no JS.

Last edited 9 years ago by johnbillion (previous) (diff)

#21 in reply to: ↑ 19 ; follow-up: @adamsilverstein
9 years ago

Replying to nacin:

This and #20299 would block #23314.

will bring this back into scope, have you reviewed the code attached? if it looks reasonable i can work to apply.

#22 @adamsilverstein
9 years ago

  • Cc adamsilverstein@… added

#23 @goto10
9 years ago

  • Cc dromsey@… added

#24 in reply to: ↑ 21 @westi
9 years ago

Replying to adamsilverstein:

Replying to nacin:

This and #20299 would block #23314.

will bring this back into scope, have you reviewed the code attached? if it looks reasonable i can work to apply.

It's still outside the scope that the revisions team will primarily focus on.

#25 @kwight
9 years ago

  • Cc kwight@… added

#26 follow-up: @markjaquith
9 years ago

From johnbillion, a very simple take: https://gist.github.com/johnbillion/5225514

#27 in reply to: ↑ 26 @adamsilverstein
9 years ago

Replying to markjaquith:

From johnbillion, a very simple take: https://gist.github.com/johnbillion/5225514

i have a patch brewing for this ticket and will post for your review monday.

@adamsilverstein
9 years ago

for testing

#28 @adamsilverstein
9 years ago

20564.diff

  • adds new wp_save_post_revision_meta() - called in _wp_put_post_revision
  • adds wp_restore_post_revision_meta() - added in restore action
  • also stores post format as revision meta (and restores on revision restore), seemed to be best way to store post_format
  • requires http://core.trac.wordpress.org/attachment/ticket/16215/16215.9.diff to work correctly (stores meta on copy of current revision, only present after patch)
  • wp_revisions_keep_meta filter to override storing of meta
  • initial testing verified post format and related meta stored and restored correctly

20564+16215.diff​ combined patch for testing

@adamsilverstein
9 years ago

updated against current trunk

@adamsilverstein
9 years ago

update against current

#29 follow-up: @markjaquith
9 years ago

We need the exact opposite approach of this patch. :-)

We should have a list of meta keys that we WILL revision, not a list of ones we WON'T. There should be no filter to opt out of revisioning of post format postmeta.

#30 in reply to: ↑ 29 @adamsilverstein
9 years ago

Replying to markjaquith:

We need the exact opposite approach of this patch. :-)

We should have a list of meta keys that we WILL revision, not a list of ones we WON'T. There should be no filter to opt out of revisioning of post format postmeta.

ok, this was the method suggested in #20299 so i went with it. a possible advantage of this method is it will catch new meta options as they are added or used, but i could also see how it could catch fields you didn't need.

i can change the method and include all current used metas, maybe add a filter for plugin authors to register new metas for revisioning?

#31 @WraithKenny
9 years ago

  • Cc Ken@… added

#32 @WraithKenny
9 years ago

I think we just need a few new wrapper functions (like add_versioned_meta(), update_versioned_meta(), and delete_versioned_meta() ) that don't check against wp_is_post_revision(). Using these would "opt in" to metadata on revisions. (of course you could currently just use *_metadata('post'...) functions, no?)

then on 'wp_restore_post_revision' (with 2 args)

$meta = get_post_meta( $revision_id, $key );
if ( empty( $meta ) )
    delete_post_meta( $post_id, $key );
else
    update_post_meta( $post_id, $key, $meta );
// or whatnot.

which is pretty straight forward (and also "opt in").
Optionally, core can hook onto 'wp_restore_post_revision' and loop thru a filterable array of "versioned" meta so that the following could work:

add_filter( 'versioned_meta', 'my_versioned_meta' );
function my_versioned_meta( $meta_keys ) {
    $meta_keys[] = 'my_key';
    return $meta_keys;
}

@WraithKenny
9 years ago

#33 @WraithKenny
9 years ago

patch introduces add_versioned_meta(), update_versioned_meta(), and delete_versioned_meta() adds the filter 'versioned_meta' and handles restoring versioned meta data in wp_restore_post_revision() Lightly tested.

#34 @WraithKenny
9 years ago

  • Keywords has-patch needs-testing added

#35 follow-up: @markjaquith
9 years ago

I don't think we're ready to bless this for plugin use. As you noted, they can just use the lower-level functions if they know what they're doing. So for this go-around, I'd skip wrapping it up all pretty. Taking a look at your patch now.

@WraithKenny
9 years ago

#36 @WraithKenny
9 years ago

new patch adds get_versioned_meta_keys

#37 in reply to: ↑ 35 @WraithKenny
9 years ago

Replying to markjaquith:

I don't think we're ready to bless this for plugin use. As you noted, they can just use the lower-level functions if they know what they're doing. So for this go-around, I'd skip wrapping it up all pretty. Taking a look at your patch now.

Yeah, that's cool. I was just working on this because it blocks #20299 which in turn blocks a couple other interesting tickets like #23314 and #23539

Figured if I got a couple working patches up it might move those next round.

@kovshenin
9 years ago

#38 @kovshenin
9 years ago

Taking a stab at this in 20564.4.diff. The patch is quite self-explanatory.

@kovshenin
9 years ago

#39 @kovshenin
9 years ago

20564.5.diff is same as .4, except the *_post_meta functions hi-jacking. Uses the underlying add_metadata where applicable.

#40 @markjaquith
9 years ago

In 23859:

Revision our post format postmeta.

props kovshenin, WraithKenny. see #20564.

#41 @DrewAPicture
9 years ago

  • Keywords needs-codex added

See [23859]

Last edited 9 years ago by DrewAPicture (previous) (diff)

#42 follow-up: @azaozz
9 years ago

Been seeing this lately in the postmeta table, post IDs 9212, 9213 and 9214 are revisions and all meta is empty (no values):

4040 	9214 	_wp_format_video 	
4039 	9214 	_wp_format_audio 	
4038 	9214 	_wp_format_image 	
4037 	9214 	_wp_format_quote_source 	
4036 	9214 	_wp_format_quote 	
4035 	9214 	_wp_format_url 	
4032 	9213 	_wp_format_video 	
4031 	9213 	_wp_format_audio 	
4030 	9213 	_wp_format_image 	
4029 	9213 	_wp_format_quote_source 	
4028 	9213 	_wp_format_quote 	
4027 	9213 	_wp_format_url 	
4022 	9212 	_wp_format_video 	
4021 	9212 	_wp_format_audio 	
4020 	9212 	_wp_format_image 	
4019 	9212 	_wp_format_quote_source 	
4018 	9212 	_wp_format_quote 	
4017 	9212 	_wp_format_url 	

Seems we are doing isset() and should be doing ! empty() somewhere.

#43 @WraithKenny
9 years ago

its the if ( false === $meta_values ) line I think

@azaozz
9 years ago

#44 @azaozz
9 years ago

In 20564-6.patch:

  • When saving revisions (including autosaves): save the current post format as revision meta.
  • When restoring from a revision, restore the format too.
  • When saving revisions: add post format meta to the revision post only for the current post format, skip when empty.
Last edited 9 years ago by azaozz (previous) (diff)

#45 in reply to: ↑ 42 @kovshenin
9 years ago

Replying to azaozz: The original post contains all those meta keys with empty values as well, and the revision post is a complete copy, so I think that's the expected behavior. I also think that there should be a more general approach for all possible meta, rather than post formats only. Thoughts?

#46 @azaozz
9 years ago

The original post contains all those meta keys with empty values as well...

Not sure that's needed either.

...the revision post is a complete copy, so I think that's the expected behavior.

No, not a complete copy. It's a copy of the post data, most fields are not revisioned. By default only title, content and excerpt are. That's why we have _wp_post_revision_fields().

Imagine a small site with 100 posts, each having 10 revisions. That's (1,100 * 7) nearly 8,000 rows in the post meta table just for post formats. And most will be empty. Now imagine a bigger site with 20,000 posts and 50 revisions each (that's not uncommon). Nearly 8,000,000 rows. And now imagine a really big site... :)

I also think that there should be a more general approach for all possible meta, rather than post formats only.

Yeah, when we open the API to revision post meta (agree with @markjaquith it's out of scope at the moment), thinking it should be opt-in. A lot of the post meta doesn't need to be saved in revisions.

#47 @kovshenin
9 years ago

I'm pretty sure it's been mentioned somewhere before, but we can probably store all the revision meta in a single serialized _revision_meta key. I agree that adding keys to revisioned meta should be opt-in and that it's out of scope for 3.6, I just dislike the post-format-ish approach at _wp_post_revision_meta_keys(), and the $single assumption in get_post_meta :)

#48 follow-up: @azaozz
9 years ago

We could, but having separate meta has some advantages. We could do a query to select posts by these meta fields which might be useful in some cases. Also that makes post formats more "futureproof".

Yes, currently the revisions meta is only for post formats, and the fields can only be "single" there. It's not very hard to turn parts of it into an API, perhaps 3.7?

@kovshenin
9 years ago

#49 in reply to: ↑ 48 ; follow-up: @kovshenin
9 years ago

Replying to azaozz: I think what Aaron meant in his comment is useful for posts only, but not really useful for revisions. I took a stab at the _revision_meta approach in 20564.6.diff which should keep the meta table clean and small for revisions. If this works out we can do the same for revisioned terms (#23893). Not really looking to fix this ticket, but rather lay a good foundation for whatever is next in 3.7 and 3.8.

P.S. Sorry for the .6 vs -6 naming conflict, that's trac's auto-naming kicking in :)

#50 @WraithKenny
8 years ago

The only drawback I can think of for serializing all the meta into one field is size concerns. For formats, it shouldn't be a problem, but if it's opened up later as an API, what if some meta are very large? Potentially, the values would be saved into individual keys, but when combined they maybe too big to store... no? It's an edge case, but who knows.

#51 follow-up: @WraithKenny
8 years ago

For the unique key issue, if the key is actually unique, then get_post_meta( $revision['ID'], $meta_key ) should only have one value in the array making it unneeded to pass a unique flag to add_post_meta (since the loop only goes once). I had a unique param in my patch originally, but after I saw the commit I thought it unnecessary. Is there a different unique assumption that I'm missing?

#52 @travisnorthcutt
8 years ago

  • Cc travis@… removed

#53 in reply to: ↑ 49 ; follow-up: @azaozz
8 years ago

Replying to kovshenin:

I took a stab at the _revision_meta approach in 20564.6.diff which should keep the meta table clean and small for revisions. If this works out we can do the same for revisioned terms (#23893).

Yeah, this works for post formats, not so sure for all meta (only need to add restoring of the post format from 20564-6.patch, perhaps to the same array). Still, having empty keys in the serialized array seems wasteful :)

As long as we know the post supports formats, we can recreate the empty keys programmatically, no need to store them in the DB. Example:

$all_meta = array_merge(
  array(
	'_wp_format_url' => '',
	'_wp_format_quote' => '',
	'_wp_format_quote_source' => '',
	...
  ),
  get_post_meta( $revision->ID, '_revision_meta', true )
);

This brings another interesting question: when restoring from a revision, do we overwrite all data stored in the main post's formats meta? If yes, do empty meta keys from the revision overwrite (i.e. remove) the corresponding values on the main post?

User case:

  • User creates a post, no format set.
  • User saves a draft creating a revision.
  • User edits the post, sets format to quote, enters data in 'url' and 'quote' meta fields.
  • User restores to the first revision. At this point do we delete the data entered in 'url' and 'quote' on the main post or do we keep it? Logically we should delete it, but if we are keeping all post formats data ever entered on the main post, the user may expect to find it if he sets the format to quote again.
Last edited 8 years ago by azaozz (previous) (diff)

#54 in reply to: ↑ 51 @azaozz
8 years ago

Replying to WraithKenny:

...if the key is actually unique, then get_post_meta( $revision['ID'], $meta_key ) should only have one value in the array making it unneeded to pass a unique flag to add_post_meta.

True, but we will need to do $meta[0] everywhere. In the current code post formats meta doesn't support multiple keys, better to use the meta API properly and get/set a single key.

#55 in reply to: ↑ 53 @kovshenin
8 years ago

Replying to azaozz:

Only need to add restoring of the post format from 20564-6.patch, perhaps to the same array.

That's taxonomy and terms, not post meta, hence the similar patch in #23893 for taxonomy. If the the serialized _revision_meta approach works well for meta, we can take a similar approach with terms and not "pollute" the term_relationships table with relations to revisions :)

Still, having empty keys in the serialized array seems wasteful :)

Maybe. We can indeed check the emptiness of meta before storing their revisions to save some space, but I have mixed feelings about it. I don't think it will affect post formats all that much, but I keep thinking that a non-existent meta value is not the same as a stored empty string, especially for multiple values under one key. If there was a $default argument to get_post_meta like there is for get_option, not storing the empty values would be a deal-breaker. So I lean towards doing delete_post_meta for empty strings when saving post format metadata. Just thinking out loud here.

This brings another interesting question: when restoring from a revision, do we overwrite all data stored in the main post's formats meta? If yes, do empty meta keys from the revision overwrite (i.e. remove) the corresponding values on the main post?

I can try and answer this with a similar question :) When restoring from a revision, do empty fields (title or content) overwrite the corresponding values in the main post? Create a post with no title, save a few revisions, give it a title, save and restore a previous revision: do we set the title back to an empty string? The answer is yes, and I think post formats (and revisioned post meta in general) should not be any different.

@kovshenin
8 years ago

#56 @kovshenin
8 years ago

In 20564.7.diff:

  • Merged some of the things from Andrew's patch
  • Switched to single value lookups
  • Save and retrieve post format via a _revision_post_format meta
  • Filters get_the_terms to show the revisioned post format during previews
  • Doesn't store empty meta values for revisions

This also covers #23893

#57 @azaozz
8 years ago

We can indeed check the emptiness of meta before storing their revisions to save some space, but I have mixed feelings about it.

What I mean is at the lowest level: we know the expected keys, so array( 'a' => '', 'b' => '', 'c' => 'something' ); doesn't have to be serialized, saved to the db and unserialized again when getting the data. We can remove the empty keys, save array( 'c' => 'something' ); and then add the empty keys on getting the data. This will work in exactly the same way as saving the original array.

The same is true when getting/setting the post format meta on revision posts. We know there are 7 meta keys, no need to add the empty.

I can try and answer this with a similar question :) When restoring from a revision, do empty fields (title or content) overwrite the corresponding values in the main post?

That's not exactly the same. From the discussion on #19570, we are keeping the unused data for post formats. Basically this is irrelevant post meta unless the user decides to switch back to a previously used post format. The question here is: do we "roll back" that irrelevant data when restoring a revision, and yes, logically we should.

Last edited 8 years ago by azaozz (previous) (diff)

@azaozz
8 years ago

#58 @azaozz
8 years ago

20564-8.patch builds on 20564.7.diff​ and adds updating of post format and post format meta for autosaves.

#59 @kovshenin
8 years ago

20564-8.patch looks good and works like a charm!

#60 @azaozz
8 years ago

In 23928:

Revisions:

  • Store the post format as meta on revisions (including autosaves).
  • Add post formats data (post meta) when autosaving.
  • Only add non-empty post formats data to revisions.
  • Correct the post format when previewing a published post.

Props kovshenin, see #19570, see #20564.

#61 @kovshenin
8 years ago

  • Keywords has-patch removed

@azaozz thanks for the commit! One little thing I noticed is the @since version in the docblock of the new _wp_preview_terms_filter function ([23928]). It says 2.6 but should be 3.6. I mistyped that in my patch, sorry!

#62 @ryan
8 years ago

[23936] for @since update.

#63 @adamsilverstein
8 years ago

  • Resolution set to fixed
  • Status changed from new to closed

#64 @helen
8 years ago

This is so not fixed. Re-open or make new?

#65 follow-up: @alexkingorg
8 years ago

This ticket seemed to get oddly intertwined with the Post Formats data - perhaps a new ticket would allow it to better exist as a stand-alone framework feature?

#66 @adamsilverstein
8 years ago

  • Keywords needs-refresh added
  • Resolution fixed deleted
  • Status changed from closed to reopened

i think the code from [23928] will work will work as is. re-opening and will refresh the patch against trunk for testing.

Last edited 8 years ago by SergeyBiryukov (previous) (diff)

#67 @SergeyBiryukov
8 years ago

  • Milestone changed from 3.6 to Future Release

@adamsilverstein
8 years ago

reintroduce changes removed in 24397

#68 @adamsilverstein
8 years ago

20564-9.patch​ first pass at reintroducing changes removed in [24397].

some small changes:

  • updated selector in autosave.js to current ui selector scheme - seems like a JS hook here would make sense, so plugin developers could use their own UI scheme for post formats
  • includes fix from #24477 (from itthinx)
Last edited 8 years ago by SergeyBiryukov (previous) (diff)

#69 @jgwspud
8 years ago

  • Cc jgwspud added

#70 @c3mdigital
8 years ago

#23973 was marked as a duplicate.

#71 @doughamlin
8 years ago

  • Cc doughamlin@… added

#72 @doughamlin
8 years ago

  • Cc doughamlin@… removed

#73 @doughamlin
8 years ago

  • Cc doughamlin@… added

#74 in reply to: ↑ 65 @WraithKenny
8 years ago

Replying to alexkingorg:

This ticket seemed to get oddly intertwined with the Post Formats data - perhaps a new ticket would allow it to better exist as a stand-alone framework feature?

Indeed, now that post-formats has been tabled, this ticket should revert to it's original intent, a General Framework for saving and restoring metadata from revisions. (Implementation shouldn't focus on post-format data.)

Some notes and considerations collected from various places:

  1. Patches derived from the existing, but removed code, should be abstracted to allow for general use.
  2. Autosaves/Previews needed to be considered: see #20299 #23539
  3. This could enable the feature here: #23314

#75 @sillybean
8 years ago

  • Cc steph@… added

#76 @donutz
8 years ago

  • Cc peterherrel@… added

#77 @jgwspud
8 years ago

  • Cc jgwspud removed

@adamsilverstein
8 years ago

includes unit test

#78 @adamsilverstein
8 years ago

lets revision some post meta!
20564-10.diff​ includes a unit test to verify the meta revisioning and filter functionality as well as improved inline hook docs.

@adamsilverstein
8 years ago

remove unused post format meta values from default array and tests

#79 @adamsilverstein
8 years ago

20564-11.diff​ - removes unused post format meta values - now revisions only 'post_format' itself, plus any meta values added via the wp_post_revision_meta_keys filter

@adamsilverstein
8 years ago

slight test cleanup

#80 @adamsilverstein
8 years ago

20564-13.diff​:

  • refresh against trunk
  • added unit test for revisioning of post_format
  • keeping post_format revisioning since post_format a default post meta field

@adamsilverstein
8 years ago

remove post format revisioning

#81 @adamsilverstein
8 years ago

20564-14.diff​:

  • remove all traces of post formats, no more post format revisioning

@DrewAPicture
8 years ago

+ docs fixes

#82 @DrewAPicture
8 years ago

  • Keywords needs-refresh removed
  • Version set to 3.4

20564.8.diff implements docs fixes for 20564-14.diff as requested.

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


8 years ago

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


8 years ago

This ticket was mentioned in IRC in #wordpress-dev by danielbachhuber. View the logs.


8 years ago

@adamsilverstein
8 years ago

Refresh against trunk. remove redundant restore block; update unit tests

#87 @adamsilverstein
8 years ago

in 20564.9.diff: refreshed against trunk; removed what appears to be redundant meta restore block; updated unit test.

@adamsilverstein
8 years ago

add wp_unslash to $_POST comparison

#88 @adamsilverstein
8 years ago

  • Keywords dev-feedback added

20564.10.diff corrects issue johnbillion pointed out in IRC - $_POST requires wp_unslash in wp_create_post_autosave or the comparison may fail.

This ticket was mentioned in IRC in #wordpress-dev by adams|mobile. View the logs.


8 years ago

This ticket was mentioned in IRC in #wordpress-dev by danielbachhuber. View the logs.


8 years ago

#91 follow-up: @TV productions
8 years ago

For the ability for plugin devs to add custom meta to custom post type revisions (#13382), you do also need a kind of javascript "filter" for the data that is send with the autosave. Something like this http://jsfiddle.net/jTjzK/3/ (just a concept to extend the data var).

#92 in reply to: ↑ 91 ; follow-up: @adamsilverstein
8 years ago

Replying to TV productions:

For the ability for plugin devs to add custom meta to custom post type revisions (#13382), you do also need a kind of javascript "filter" for the data that is send with the autosave. Something like this http://jsfiddle.net/jTjzK/3/ (just a concept to extend the data var).

I'm not sure this is required. All fields should be 'sent' with the auto update post, and the attached patch filters these fields and revisions ones that are specified. All fields are sent, and the patch allows authors to specify which fields to revision, Does that make sense? If not can you please explain a bit more what you would want to revision that the current patch would not work for?

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


8 years ago

@TV productions
8 years ago

The data that an autosave sent in wp 3.9-alpha-27445-src

#94 in reply to: ↑ 92 ; follow-up: @TV productions
8 years ago

Replying to adamsilverstein:

Replying to TV productions:

For the ability for plugin devs to add custom meta to custom post type revisions (#13382), you do also need a kind of javascript "filter" for the data that is send with the autosave. Something like this http://jsfiddle.net/jTjzK/3/ (just a concept to extend the data var).

I'm not sure this is required. All fields should be 'sent' with the auto update post, and the attached patch filters these fields and revisions ones that are specified. All fields are sent, and the patch allows authors to specify which fields to revision, Does that make sense? If not can you please explain a bit more what you would want to revision that the current patch would not work for?

Just to check, I've pulled the latest code form the repo and applied the latest patch (20564.10.diff).
As you can see in the attached image The data that an autosave sent in wp 3.9-alpha-27445-src the default meta fields are saved.

But what I would like to see is a way to "prepaire" the data that will be saved into the meta field. The post type in the image is a photo album, and instead of "normal" content it saves some image data and the server generates the post_content from this meta field. So I don't have one html input field that matches an meta field, but a lot. There are different solutions to this: (1) create a field that does matches the meta field and that is updated by javascript on autosave (so you need a hook for that) or (2) a "jsfilter" to generate the data and pass it trough.

As I write this, I note that it is kinda focussed to my example, but what I actually would say is: could we make an autosave API where you can add data on client side and extract (and save) it on the server side?

#95 in reply to: ↑ 94 ; follow-up: @adamsilverstein
8 years ago

Replying to TV productions:

Replying to adamsilverstein:

Replying to TV productions:

For the ability for plugin devs to add custom meta to custom post type revisions (#13382), you do also need a kind of javascript "filter" for the data that is send with the autosave. Something like this http://jsfiddle.net/jTjzK/3/ (just a concept to extend the data var).

I'm not sure this is required. All fields should be 'sent' with the auto update post, and the attached patch filters these fields and revisions ones that are specified. All fields are sent, and the patch allows authors to specify which fields to revision, Does that make sense? If not can you please explain a bit more what you would want to revision that the current patch would not work for?

Just to check, I've pulled the latest code form the repo and applied the latest patch (20564.10.diff).
As you can see in the attached image The data that an autosave sent in wp 3.9-alpha-27445-src the default meta fields are saved.

But what I would like to see is a way to "prepaire" the data that will be saved into the meta field. The post type in the image is a photo album, and instead of "normal" content it saves some image data and the server generates the post_content from this meta field. So I don't have one html input field that matches an meta field, but a lot. There are different solutions to this: (1) create a field that does matches the meta field and that is updated by javascript on autosave (so you need a hook for that) or (2) a "jsfilter" to generate the data and pass it trough.

As I write this, I note that it is kinda focussed to my example, but what I actually would say is: could we make an autosave API where you can add data on client side and extract (and save) it on the server side?

Thank you for the more detailed description and the screenshot.

I think what you are looking for is a way to hook in right before the autosave, or a filter applied to the transmitted autosave data. This type of JavaScript hook or action is currently not standardized in WordPress - see ticket #21170 for more details and a proposed solution.

In the mean time you may be able to hook in using this:

$( document ).on( 'before-autosave', function() { /* Your Function */ } );

(based on this code)

@adamsilverstein
8 years ago

Refresh against trunk

#96 in reply to: ↑ 95 @TV productions
8 years ago

Replying to adamsilverstein:

Replying to TV productions:

Replying to adamsilverstein:

Replying to TV productions:

[...]

[...]

[...]

Thank you for the more detailed description and the screenshot.

I think what you are looking for is a way to hook in right before the autosave, or a filter applied to the transmitted autosave data. This type of JavaScript hook or action is currently not standardized in WordPress - see ticket #21170 for more details and a proposed solution.

In the mean time you may be able to hook in using this:

$( document ).on( 'before-autosave', function() { /* Your Function */ } );

(based on this code)

Okay, thanks for pointing me in the right direction and for the jQuery hook. I am going to dig into #21170.

Last edited 8 years ago by TV productions (previous) (diff)

@adamsilverstein
7 years ago

refresh against trunk

#97 @adamsilverstein
7 years ago

20564.12.diff refresh against trunk, verified unit tests still pass.

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


7 years ago

#99 @helen
7 years ago

#28553 was marked as a duplicate.

@adamsilverstein
7 years ago

refresh against trunk

#100 @adamsilverstein
7 years ago

20564.13.diff - Refresh against trunk, slightly updated

  • Working on a version that only saves changed revision meta values

@adamsilverstein
7 years ago

only save changed revisions

#101 @adamsilverstein
7 years ago

20564.14.diff

  • Only save metas that have changed
  • Keep a serialized array of the 'whitelisted' (revisioned) meta keys
  • When restoring a revision, traverse back thru past revisions to find the last time the meta was revisioned

While this patch works and the unit tests pass, it seems a little too complicated. I'm going to work on this a bit more - keeping the serialized array of the 'whitelisted' (revisioned) meta keys, but switching to only saving non-blank meta values. This will eliminate the complicated traversal back to find the previously stored meta. We will still be creating rows for each (non-blank) meta which I think is ok as long as we make that fact clear to developers.

@adamsilverstein
7 years ago

don't save blank meta, track revisioned keys

#102 follow-up: @adamsilverstein
7 years ago

In 20564.15.diff:

  • Don't store blank meta values
  • Track meta keys stored for each revision
  • Updated unit test to test restoring blank meta

@adamsilverstein
7 years ago

update unit test, restore revision with untracked key

@adamsilverstein
7 years ago

account for the storing of multiple values per key

#103 @adamsilverstein
7 years ago

in 20564.17.diff - account for multiple meta values per key, added test for this, deserves more testing

This ticket was mentioned in IRC in #wordpress-dev by helen. View the logs.


7 years ago

#105 in reply to: ↑ 102 ; follow-up: @p51labs
7 years ago

Replying to adamsilverstein:

In 20564.15.diff:

  • Don't store blank meta values
  • Track meta keys stored for each revision
  • Updated unit test to test restoring blank meta

I think that blank meta should be stored if exists on the current post. Sometimes a blank value is the intended value. A case an point would be a field with checkboxes, by setting a blank value I know they purposely didn't select anything from the list.

Thoughts?

Last edited 7 years ago by p51labs (previous) (diff)

#106 in reply to: ↑ 105 @adamsilverstein
7 years ago

Thanks for the feedback!

The issue is that when retrieving meta, WordPress returns blank if the meta is not set, OR if the meta is blank - so not storing the meta is the same as storing blank meta :) (unless I'm missing something)

the trick here is that because I am tracking which metas are 'revisioned' for each stored revision, i know that a meta that is revisioned and for which no value was stored is in fact blank; therefore, when restoring a revision with a meta that is missing (but which was tracked), that meta is considered blank, and the restored value is set as blank (guess I could just delete it).

Does that make sense? in short, I am tracking blank metas, just not bothering to store them.

Replying to p51labs:

Replying to adamsilverstein:

In 20564.15.diff:

  • Don't store blank meta values
  • Track meta keys stored for each revision
  • Updated unit test to test restoring blank meta

I think that blank meta should be stored if exists on the current post. Sometimes a blank value is the intended value. A case an point would be a field with checkboxes, by setting a blank value I know they purposely didn't select anything from the list.

Thoughts?

Last edited 7 years ago by adamsilverstein (previous) (diff)

#107 follow-up: @p51labs
7 years ago

Let me expand a little on my previous example. Let's say I have 3 checkboxes, all for one meta_key and the values are 1,2,3. Now by default in my meta box I set 1,3 as checked. Now a user comes in and creates a post and decides none of them should be checked. Now not storing the data is accurate however it doesn't tell me that the user unchecked anything so when I render the field again do I assume I need to load the default values or now leave them all unchecked? I suppose a I could check whether or not the post is new or being edited but is that the best approach?

This solution requires checking for the meta and if the meta key exists.

Just throwing in some thoughts, thanks for taking the time to consider them.

#108 in reply to: ↑ 107 @adamsilverstein
7 years ago

I think you can solve your problem using metadata_exists to check to the presence of the meta data. I don't think this issue affects the revisioning of post meta, deserves some testing!

Replying to p51labs:

Let me expand a little on my previous example. Let's say I have 3 checkboxes, all for one meta_key and the values are 1,2,3. Now by default in my meta box I set 1,3 as checked. Now a user comes in and creates a post and decides none of them should be checked. Now not storing the data is accurate however it doesn't tell me that the user unchecked anything so when I render the field again do I assume I need to load the default values or now leave them all unchecked? I suppose a I could check whether or not the post is new or being edited but is that the best approach?

This solution requires checking for the meta and if the meta key exists.

Just throwing in some thoughts, thanks for taking the time to consider them.

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


7 years ago

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


7 years ago

@adamsilverstein
7 years ago

refresh against trunk

@adamsilverstein
7 years ago

refresh

#111 follow-up: @adamsilverstein
7 years ago

20564.19.diff

  • refresh against trunk
  • verify unit tests pass

#112 in reply to: ↑ 111 @Andrew Moawad
7 years ago

Last edited 7 years ago by Andrew Moawad (previous) (diff)

This ticket was mentioned in IRC in #wordpress-dev by johnbillion. View the logs.


7 years ago

This ticket was mentioned in IRC in #wordpress-dev by adamsilverstein. View the logs.


7 years ago

@adamsilverstein
7 years ago

hook for autosave

#115 @adamsilverstein
7 years ago

I have refactored the latest code on this ticket as a plugin - https://github.com/adamsilverstein/wp-20564

Only one additional hook is required to complete functionality (and only for the or the autosaving of post meta), I added that in 20564-new-action.diff

I haven't tested the plugin carefully yet, my next step is getting the existing unit tests to pass.

@adamsilverstein
7 years ago

pass entire $new_autosave array

@adamsilverstein
7 years ago

add one filter, unit tests

#116 @adamsilverstein
7 years ago

One more filter was required: on my list to document these new hooks/filters, the check for change wasn't quite right.

With 20564.20.diff and the plugin ( https://github.com/adamsilverstein/wp-20564 ) metas are revisioned.

I wasn't certain how to run the unit tests when a plugin is required, I found that dropping a copy of wp-20564.php in trunk/tests/phpunit/tests/post/ did the trick for me, with that in place and the patch, all tests pass.

@adamsilverstein
7 years ago

Adds hook docs

This ticket was mentioned in Slack in #core by adamsilverstein. View the logs.


7 years ago

#119 @mattheu
7 years ago

I have tested this plugin & related patch and its working well.

I think it is highly desirable for the revisioned meta fields to be included in the revision diff UI.

On this related ticket: #29920 I added a filter that allows revisioned meta fields to be added here. I am updating the patch on this ticket to include this.

I have also made a new version of the plugin to handle this. I will open a PR on github with these changes.

UPDATE - here is the pull request on github: https://github.com/adamsilverstein/wp-20564/pull/2

Last edited 7 years ago by johnbillion (previous) (diff)

@mattheu
7 years ago

This ticket was mentioned in Slack in #core-restapi by rachelbaker. View the logs.


7 years ago

@mattheu
7 years ago

#121 @mattheu
7 years ago

Added the correct patch!

Also thought about the idea of using the current register_meta function - which supports an $args param to register meta keys for revisions.

#122 follow-up: @johnbillion
7 years ago

  • Milestone changed from Future Release to 4.1

After some discussion at WCSF, moving to 4.1 for the temporary hooks suggested by adamsilverstein and matt_eu above.

#123 in reply to: ↑ 122 @mattheu
7 years ago

Replying to johnbillion:

After some discussion at WCSF, moving to 4.1 for the temporary hooks suggested by adamsilverstein and matt_eu above.

johnbillion asked me (https://wordpress.slack.com/archives/core/p1414551155002002) to split up the unit tests - however these tests are actually related to the plugin that uses the new hooks and should probably not belong in core. I've updated the patch to remove them.

I will open a PR on github to add the tests to the plugin.

Also added some more documentation.

@mattheu
7 years ago

#124 @johnbillion
7 years ago

In 30091:

Introduce some actions and filters which aid plugins in revisioning post meta.

  • wp_save_post_revision_post_has_changed filter which can be used to determine if a post has been changed, and therefore if a revision should be created for a post.
  • wp_get_revision_ui_diff filter which can be used to filter the fields displayed in the post revision diff UI.
  • wp_creating_autosave action which is fired just before an autosave is created.

See #20564.
Props mattheu, adamsilverstein.

#125 @johnbillion
7 years ago

  • Keywords needs-testing needs-codex dev-feedback removed
  • Milestone changed from 4.1 to Future Release

#126 @adamsilverstein
7 years ago

I have bundled up the code for this feature and released to the .org repository, requires trunk or 4.1: https://wordpress.org/plugins/wp-post-meta-revisions/

Please test! Issues and pull requests welcome on the GitHub repo.

This ticket was mentioned in Slack in #core by adamsilverstein. View the logs.


7 years ago

#128 @adamsilverstein
6 years ago

  • Keywords dev-feedback added
  • Owner set to adamsilverstein
  • Status changed from reopened to assigned

This ticket was mentioned in Slack in #core-fields by khromov. View the logs.


6 years ago

This ticket was mentioned in Slack in #core by adamsilverstein. View the logs.


5 years ago

This ticket was mentioned in Slack in #forums by netweb. View the logs.


4 years ago

#132 @brothman01
3 years ago

Obviously this is an old ticket but I agree that this would be a good feature too

#133 @adamsilverstein
3 years ago

@brothman01 thanks! it is still a valid ticket. please test the plugin if you need this feature.

#134 @chrissiq
3 years ago

@adamsilverstein, there are a lot of bug fixes available on the plugin on github as PRs, but none of them are getting resolved and merged into master. I had to create my own fork of the repo and merge in a lot of PRs, fix bugs, etc, in order to get the plugin to work. This isn't something the community can do, the maintainer (you?) needs to review, or set reviewers, and approve the PRs I guess? Is the github repo at parity with the plugin download on the wordpress site?

#135 @adamsilverstein
3 years ago

@chrissiq

Apologies for my lack of activity on maintaining the plugin, I hope to loop back to it soon to review and merge any PRs that are good. I welcome any help in form of reviewing PRs, writing tests, etc.

The github repo is at parity with the plugin in .org, when I get to merging the outstanding PRs I will update it as well.

#136 @chrissiq
3 years ago

Thanks @adamsilverstein !

#137 @brothman01
3 years ago

I am using WordPress 5.1 and CMB2 to add the fields.

I am on WordPress 5.1 and installed the plugin from the repo, added the code snippet to my functions and changed the key to the real key. Should I do anything else to set this up or should it now be work but it's not?

#138 @adamsilverstein
3 years ago

@brothman01 that is how it should work. are you sure it isn't working? the meta will not show up in the revisions UI, but will be restored when you restore the revision it was attached to.

Note: See TracTickets for help on using tickets.