Page Comparison

Table of Contents

Overview

...

...

Anchor
stage1 stage1

Stage 1 - Import and parse reference dataset (Optional)

This optional stage is run once per Bulk Loader process. This stage can be skipped if the reference dataset is already available or if the optional 'filter by reference' step (Step 2.5) is skipped.

...

Anchor
stage3 stage3

Stage 3 - Geocode and filter

•  

  Step 3.1 - Geocode source dataset

...

Anchor
stage4 stage4

Stage 4 - Export full set (single batch) or subset (multiple batches)

...

Anchor
stage5 stage5

Stage 5 - Run the Bulk Loader

 For a complete set of steps and background about the Bulk Loader, see also Running the Bulk Loader, a page dedicated to its input, operation and results.

...

Anchor
stage6 stage6

Stage 6 - Extract results

•  

  Step 6.1 - Archive exceptions

...

1. Get the unique EAS change_request_id created by the Bulk Load operation. The value of <change_request_id> will be used in the next steps to count addresses added to the EAS.
   

   1. Query the 'public.change_requests' table for the new 'change_request_id' value.

      Code Block
      language sql firstline 1 title change_request_id linenumbers true
      SELECT change_request_id FROM public.change_requests WHERE requestor_comment LIKE 'bulk load change request' ORDER BY change_request_id DESC LIMIT 1;

      
      

   2. Save the file in the network folder dedicated to artifacts for the Bulk Loader iteration.
      • For example, R:\Tec\..\Eas\_Task\path\to\archive\bulkloader_YYYYMMDD\bulkloader\batch_002\change_request_id.csv
2. Artifacts
   1. change_request_id.csv - The unique EAS change_request_id created by the Bulk Load operation.

•  

  Anchor
  step6.3 step6.3

  Step

  Step 6.3 -

  Archive new EAS address_base

  Archive new EAS addresses records

1. Get all the base address records (including units) added to the EAS during the Bulk Loader operation..
   

   1. Query the public.address_baseaddresses table on the new change_request_id value.

      Code Block
      language sql firstline 1 title public.address_baseaddresses linenumbers true
      SELECT activate_change_request_id, address_id, public.address_base.* * FROM public.address_base, public.addresses WHERE public.address_base.address_base_id = public.addresses.address_base_id AND public.addresses.address_base_flg = TRUE AND public.addresses.activate_change_request_id = <change_request_id>;

      
      

   2. Save the file in the network folder dedicated to artifacts for the Bulk Loader iteration.
      • For example, R:\Tec\..\Eas\_Task\path\to\archive\bulkloader_YYYYMMDD\bulkloader\batch_002\address_baseaddresses.csv
2. Artifacts
   1. address_baseaddresses.csv - All the base address records (including units) added to the EAS during the Bulk Loader operation.

•  

  Anchor
  step6.4 step6.4

  Step 6.4 -

  Archive new EAS addresses

  Archive new EAS address_base records

1. Get all the address base records (including units) added to the EAS during the Bulk Loader operation..
   

   1. Query the public.addressesaddress_base table on the new change_request_id value.

      SELECT * FROM public.addresses WHERE

      Code Block
      language sql firstline 1 title public.addresses linenumbers true	title public.address_base linenumbers true
      SELECT activate_change_request_id, address_id, public.address_base.* FROM public.address_base, public.addresses WHERE public.address_base.address_base_id = public.addresses.address_base_id AND public.addresses.address_base_flg = TRUE AND public.addresses.activate_change_request_id = <change_request_id>;

      
      

   2. Save the file in the network folder dedicated to artifacts for the Bulk Loader iteration.
      • For example, R:\Tec\..\Eas\_Task\path\to\archive\bulkloader_YYYYMMDD\bulkloader\batch_002\addressesaddress_base.csv
2. Artifacts
   1. addressesaddress_base.csv - All the address base records (including units) added to the EAS during the Bulk Loader operation.

...

Compare the results of Stage 5 with the results from Stage 6.

1. The number of base addresses found in the Stage 5 Analysis Step 5.6 (2) should be identical to the number of base addresses found in Step 6.3.

2. The number of base addresses found in the Stage 5 Analysis should be less than or equal Step 5.6 (2) should be identical to the number of base addresses listed found in Step 6.4. (The Bulk Loader does not provide enough information in the the bulkloader.address_extract table to determine the exact number of new addresses added. But there is enough information to determine an upper limit.)

Anchor
stage7 stage7

Stage 7 - Cleanup and Restoration

...

1. If the Bulk Loader Process was run on the production server then restore services

   1. SKIP Turn on production-to-replication service

      • Re-enable database replication by restarting the database service on the replication server (DR PROD DB).

        
        

        Code Block
        language bash title Stop PostgreSQL linenumbers true
        sudo -u postgres -i /usr/pgsql-9.0/bin/pg_ctl -D /data/9.0/data start

        
        

   2. SKIP Turn on downstream database propagation service(s)

      • Resume downstream replication to internal business system database (SF PROD WEB).

        Code Block
        language text firstline 1 title start xmit
        sudo /var/www/html/eas/bin/xmit_change_notifications.bsh start

        
        

   3. Enable front-end access to EAS

      • Place the Web servers into live mode (SF PROD WEB, DR PROD WEB).

        Code Block
        language bash linenumbers true
        cd /var/www/html sudo ./set_eas_mode.sh LIVE

        
        

...