Implementation discussion: update-table changes

[taoensso]

Implementation discussion: update-table changes

[ptaoussanis]

Hi Ricardo,

The breaking change you have in mind sounds good to me, thanks for checking.

[ricardojmendez]

It looks like update-table's implementation right now is very throughput-specific, including mapping the update call on a series of throughput increase steps and returning the last one executed.

Is there a reason for this? I'm going through the referenced page but don't see a reason why the update request would be executed in steps, only the explanation for the decrease limit in a 24 hour period.

[ptaoussanis]

Was the case previously that large throughput increases needed manual steps. Not sure if that's still the case or not. If not, that code's vestigial and can be removed.

[ricardojmendez]

Perfect. I'll see about removing it and running some tests against an actual live instance, since I've read some remarks that the local instance disregards throughput settings (it referred to global secondary indexes, but I expect is a general characteristic).

[ptaoussanis]

Ahh yes, limits like that would only apply to a live cloud instance. Not sure if this particular limit still exists though.

[ricardojmendez]

No problem, I'll test. If the limits no longer exist then things would be much simpler, since I can just unify all the table updates - otherwise it'd be best to keep separate update-table and update-table-throughput functions.

[ricardojmendez]

Testing against a live cloud instance, I can get the update to throughput to apply in a single step. Will prune that old code.

[ptaoussanis]

Just confirming: that's for a large increase, yes? I.e. more than 2x or 4x the previous value?

[ricardojmendez]

Correct, tried it going from {:read 1 :write 1} to {:read 16 :write 16} without stepping. No error and update returned the expected values

; First increase
{:lsindexes nil,
 :gsindexes nil,
 :name :temp_table_1450109809826,
 :throughput
 {:read 16,
  :write 16,
  :last-decrease nil,
  :last-increase #inst "2015-12-14T16:16:58.340-00:00",
  :num-decreases-today 0},
 :prim-keys {:artist {:key-type :hash, :data-type :s}},
 :size 0,
 :status :active,
 :item-count 0,
 :creation-date #inst "2015-12-14T16:16:49.943-00:00",
 :indexes nil}
; Second increase
{:lsindexes nil,
 :gsindexes nil,
 :name :temp_table_1450109809826,
 :throughput
 {:read 256,
  :write 256,
  :last-decrease nil,
  :last-increase #inst "2015-12-14T16:17:03.542-00:00",
  :num-decreases-today 0},
 :prim-keys {:artist {:key-type :hash, :data-type :s}},
 :size 0,
 :status :active,
 :item-count 0,
 :creation-date #inst "2015-12-14T16:16:49.943-00:00",
 :indexes nil}

[ptaoussanis]

Great, happy to see that they've removed that limit- thanks for picking up on this.

[ricardojmendez]

Closing along with #80