{"id":6455,"date":"2012-09-24T17:14:34","date_gmt":"2012-09-24T22:14:34","guid":{"rendered":"http:\/\/bobbeaty.com\/wp\/?p=6455"},"modified":"2012-09-24T19:45:32","modified_gmt":"2012-09-25T00:45:32","slug":"great-way-to-skin-a-cat","status":"publish","type":"post","link":"https:\/\/bobbeaty.com\/wp\/archives\/6455","title":{"rendered":"Great Way to Skin a Cat"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/bobbeaty.com\/wp\/wp-content\/uploads\/2008\/06\/webdevel.jpg\" alt=\"WebDevel.jpg\" title=\"WebDevel.jpg\" border=\"0\" width=\"128\" height=\"128\" style=\"float:right;\" \/><\/p>\n<p>Today we've been once again fighting Salesforce.com's APEX APIs for getting Merchant data from their servers. It's a key part of our processing, and they have an API, but it's got some <em>major<\/em> limitations, and one of the problems is getting all the merchants for a division (like Cleveland, Cincinnati, etc.) of The Shop. As we were kicking around ideas, one of my co-workers came up with the idea to fetch all the IDs <em>first<\/em>, and because there's not a lot of data in just the IDs, it's possible to get all the merchant IDs in one hit.<\/p>\n<p>Then, once we have the IDs, we can make a series of <em>parallel<\/em> requests where we chop this up into requests of 100 or 1000 merchants a piece. There are a lot of benefits in this plan - first, we know the IDs right off the bat, and if we don't get valid data for them, at least we know what to <em>clear<\/em> if we need to. Secondly, by knowing all the IDs up front, we can make a series of async, parallel requests that will make the data loading a lot faster.<\/p>\n<p>It's days like this, with pretty smart guys that I get a giggle. This is going to take a few hours to do, but in the end, it'll be a <strong><em>huge<\/em><\/strong> improvement in the processing of the data.<\/p>\n<p>Fantastic!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today we&#8217;ve been once again fighting Salesforce.com&#8217;s APEX APIs for getting Merchant data from their servers. It&#8217;s a key part of our processing, and they have an API, but it&#8217;s got some major limitations, and one of the problems is getting all the merchants for a division (like Cleveland, Cincinnati, etc.) of The Shop. As [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,6],"tags":[],"class_list":["post-6455","post","type-post","status-publish","format-standard","hentry","category-coding","category-cube-life"],"_links":{"self":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts\/6455","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/comments?post=6455"}],"version-history":[{"count":2,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts\/6455\/revisions"}],"predecessor-version":[{"id":6457,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts\/6455\/revisions\/6457"}],"wp:attachment":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/media?parent=6455"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/categories?post=6455"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/tags?post=6455"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}