Tutorials

  1. Home
  2. Docs
  3. Tutorials
  4. 80: How to load mass data using bulk api using Agent?

80: How to load mass data using bulk api using Agent?

Introduction:

Bulk API 2.0 provides a simple interface for quickly loading large amounts of data into your Salesforce org.

Bulk API 2.0 is available in API version 41.0 and later.

The API includes the following features.

  • Support for OAuth 2.0

Bulk API 2.0 supports all OAuth flows supported by Salesforce’s other

REST APIs.

  • Automatic File Batching

Bulk API 2.0 simplifies uploading large amounts of data by breaking the

data into batches automatically. All you have to do is upload a CSV file

with your record data and check back when the results are ready.

  • Daily Limits Based on Number of Records

Instead of limiting the amount of data uploaded daily by the quantity of

jobs, Bulk API 2.0 uses a limit of total records uploaded. The limit is 100

million records per 24-hour period.

What is bulk API?

The Bulk API provides a programmatic option to quickly load your org’s data into Salesforce. … Bulk API is based on REST principles and is optimized for loading or deleting large sets of data. You can use it to query, queryAll, insert, update, upsert, or delete many records asynchronously by submitting batches.

The configuration of Bulk API in SFDC

To enable interface for Bulk API feature, go to outbound interface detail on Salesforce, in the Streaming and Bulk Configuration section. Check the Bulk Mode checkbox.

 

 

 

 

Before configuring Bulk API, there are some rules you must know:

Prerequisite

Before configuring Bulk Interface Processing, you have to know about the parameters:

– BULK Mode: Check this flag if you want to run interface in a bulk mode using Salesforce BULK API.

– Bulk Version: We support SFDC pure bulk mode in version 1.0 or 2.0. Then we have our own SKYVVA bulk mode. This use SKYVVA workflow and mapping and thus are more powerful but slower than the pure bulk api technique from Salesforce. This one is SKYVVA own bulk mode.

– Bulk Processing Mode: This field indicates the two-mode, which is support with bulk version 1.0. With bulk, version 2.0 only parallel mode is supported. Therefore, the value here depends on the selection of the field bulk version e.g. when we want to use ‘Serial’ then we need to choose ‘Bulk V 1.0’. There are two modes which are:

  1. Parallel: When you select this processing mode, it will run parallel.
  2. Serial: When you select this mode, it will not run at the same time.

– Bulk Package Size: This parameter determine how many records is splitted into Bulk data size. If your Message contain 10.000 records and the value for this parameter is 1000 so you will get 10 bulk data set in Salesforce.

– Bulk Monitor Keep Size: The number of bulk execute logs to be keep.

– Bulk Sch Frequency: This is the schedule time frequency for bulk scheduler on interface.

– Bulk Integrate Time Interval (minute): The interval (minutes) used for integrate bulk job scheduler. For example, if its value is 10, then the integrate bulk scheduler will be run every 10 minutes.

For detail information:

https://trailhead.salesforce.com/en/content/learn/modules/api_basics/api_basics_bulk

1.1.2 Integrate from other system

Assuming you already have created interface since this part will be focus on integrate from Agent as an example. To integrate from Agent, please run Agent-UI and more steps as following:

  • After running the Agent-UI, the Integration Control Board will popup then you have to click on Integration Wizard

 

  • Select the Property File

 

  • Select the existing integration and interface

 

  • After selecting the interface you will be land on Interface Source Definition a place where you can configuring the adapter. To create adapter please click on this link (How to create adapter in Agent). After creating the adapter, you can test the Query to see the data and then save it.

 

1.1.3 To schedule 

To be able to integrate your data you can either process them manually or use the scheduler. This section will show how to do scheduler.

Go back to Agent Control Board and then select

 

  • Select the name of Integration and interface along with Integration Mode then turn on the schedule and choose the time you want to run.

 

  • Enter Salesforce and go to Message Monitoring Board to check the result.

Was this article helpful to you? Yes No

How can we help?