Skip to content

Commit

Permalink
Update from SAP DITA CMS (squashed):
Browse files Browse the repository at this point in the history
commit 1b8de08557b98340c642898eb717c736a7a68ac3
Author: REDACTED
Date:   Mon Jan 15 18:43:26 2024 +0000

    Update from SAP DITA CMS 2024-01-15 18:43:26
    Project: dita-all/jrs1701160047911
    Project map: af2fcb3e6dd448f3af3c0ff9c70daaf9.ditamap
    Language: en-US

commit b325308b79acbce5fd06fee7f336f9044368009c
Author: REDACTED
Date:   Mon Jan 15 18:41:02 2024 +0000

    Update from SAP DITA CMS 2024-01-15 18:41:02
    Project: dita-all/jrs1701160047911
    Project map: af2fcb3e6dd448f3af3c0ff9c70daaf9.ditamap
    Language: en-US

commit 7dc24fc712220013496ab84fc82a7372be965b28
Author: REDACTED
Date:   Mon Jan 15 18:40:56 2024 +0000

    Update from SAP DITA CMS 2024-01-15 18:40:56
    Project: dita-all/jrs1701160047911
    Project map: af2fcb3e6dd448f3af3c0ff9c70daaf9.ditamap
    Language: en-US

commit 923358d5b5984241ab8572f1d2d53b2a963f7e86
Author: REDACTED
Date:   Mon Jan 15 16:21:20 2024 +0000

    Update from SAP DITA CMS 2024-01-15 16:21:20

##################################################
[Remaining squash message was removed before commit...]
  • Loading branch information
ditaccms-bot committed Jan 17, 2024
1 parent c2b0b26 commit 5c64ce3
Show file tree
Hide file tree
Showing 67 changed files with 1,392 additions and 323 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ By default, table data is stored on disk. You can improve performance by enablin
<tr>
<td valign="top">

In-Memory Storage
*Store Table Data in Memory*

</td>
<td valign="top">
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -208,7 +208,7 @@ All the objects you import or create in the *Data Builder* are listed on the *Da
- Local Table \(see [Creating a Local Table](creating-a-local-table-2509fe4.md)\)
- Graphical View \(see [Creating a Graphical View](../creating-a-graphical-view-27efb47.md)\)
- SQL View \(see [Creating an SQL View](../creating-an-sql-view-81920e4.md)\)
- Data Access Control \(see [Create a "Simple Values" Data Access Control](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/5246328ec59045cb9c2aa693daee2557.html "Users with the DW Space Administrator role (or equivalent privileges) can create data access controls in which criteria are defined as simple values. Each user can only see the records that match any of the single values she is authorized for in the permissions entity.") :arrow_upper_right:\)
- Data Access Control \(see [Create a "Single Values" Data Access Control](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/5246328ec59045cb9c2aa693daee2557.html "Users with the DW Space Administrator role (or equivalent privileges) can create data access controls in which criteria are defined as single values. Each user can only see the records that match any of the single values she is authorized for in the permissions entity.") :arrow_upper_right:\)
- Analytic Model \(see [Creating an Analytic Model](../Modeling-Data-in-the-Data-Builder/creating-an-analytic-model-e5fbe9e.md)\)
- Task Chain \(see [Creating a Task Chain](creating-a-task-chain-d1afbc2.md)\)

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -28,8 +28,11 @@ Add a source to read data from. You can add multiple sources and combine them to

> ### Note:
> - You cannot use views with input parameters as sources in a data flow.
> - When browsing a remote file storage such as Amazon Simple Storage Service, Google Cloud Storage, or Microsoft Azure Blob Storage, you can only select files of type JSON/JSONL, CSV, XLS/XLSX, ORC, or PARQUET.
> - Local tables with delta capture can be added as source tables. However only the active records will be used. See [Capturing Delta Changes in Your Local Table](capturing-delta-changes-in-your-local-table-154bdff.md)
> - When browsing a remote file storage such as Amazon Simple Storage Service, Google Cloud Storage, or Microsoft Azure Blob Storage, you can only select files of type JSON/JSONL, CSV, XLS/XLSX, ORC, or PARQUET. Note that each cloud provider has its own naming convention for defining bucket and object names. These conventions should be followed accordingly to avoid any source-related issue. Even though Flowagent-based operators accept most special characters, we recommend that only alphanumeric characters are used \(no multibyte characters\). This will avoid any undesired issue because all sources work well with such characters. Furthermore, some special characters such as ", +, and , are not allowed by our Flowagent File Producer operator and should not be used.
> - Local tables with delta capture can be added as source tables. However, only the active records will be used. See [Capturing Delta Changes in Your Local Table](capturing-delta-changes-in-your-local-table-154bdff.md)
> ### Restriction:
> If you add an excel file, you must ensure that the file size does not exceed 50 MB.
4. Click the source node to display its properties in the side panel, and complete the properties in the *General* section:

Expand All @@ -50,7 +53,7 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Label
*Label*

</td>
<td valign="top">
Expand All @@ -62,19 +65,50 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Business Name / Technical Name / Type / Connection
*Business Name / Technical Name / Type / Connection*

</td>
<td valign="top">

\[read-only\] Provide information to identify the source table.

</td>
</tr>
<tr>
<td valign="top">

Package

</td>
<td valign="top">

\[read-only\] Provide information to identify the source.
Select the package to which the object belongs.

Packages are used to group related objects in order to facilitate their transport between tenants.

> ### Note:
> Once a package is selected, it cannot be changed here. Only a user with the DW Space Administrator role \(or equivalent privileges\) can modify a package assignment in the *Packages* editor.
For more information, see [Creating Packages to Export](https://help.sap.com/viewer/9f36ca35bc6145e4acdef6b4d852d560/DEV_CURRENT/en-US/24aba84ceeb3416881736f70f02e3a0a.html "Users with the DW Space Administrator role can create packages to model groups of related objects for transport between tenants. Modelers can add objects to packages via the Package field, which appears in editors when a package is created in their space. Once a package is complete and validated, the space administrator can export it to the Content Network. The structure of your package is preserved and, as the objects it contains evolve, you can easily export updated versions of it.") :arrow_upper_right:.

</td>
</tr>
<tr>
<td valign="top">

Status
*Type*

</td>
<td valign="top">

Type of object. For example: a local table.

</td>
</tr>
<tr>
<td valign="top">

*Status*

</td>
<td valign="top">
Expand All @@ -88,12 +122,12 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Use As
*Use As*

</td>
<td valign="top">

\[local tables\] Specifies whether the table is used as a *Source* or *Target* in the data flow.
\[read-only\] Specifies whether the table is used as a Source or Target in the data flow.

> ### Note:
> Changing the use of a table will reset all its properties.
Expand Down Expand Up @@ -188,7 +222,7 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Control Fetch Size
*Control Fetch Size*

</td>
<td valign="top">
Expand All @@ -200,7 +234,7 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Fetch Size \(Number of Rows\)
*Fetch Size \(Number of Rows\)*

</td>
<td valign="top">
Expand All @@ -212,7 +246,7 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Batch Query
*Batch Query*

</td>
<td valign="top">
Expand All @@ -224,13 +258,30 @@ Add a source to read data from. You can add multiple sources and combine them to
<tr>
<td valign="top">

Fail Run on String Truncation
*Fail Run on String Truncation*

</td>
<td valign="top">

Fails the data flow run if string truncation is detected while fetching the source columns. This property is available only for CSV, JSON, and Excel files.

</td>
</tr>
<tr>
<td valign="top">

*Enable ODBC Tracing*

</td>
<td valign="top">

: \[SAP HANA connection only\] Enable this option to create a new log file in the vflow graph pod with HANA ODBC debug logs.

> ### Caution:
> Enabling this option must be used for troubleshooting purposes only, as it uses a lot of system resources.


</td>
</tr>
</table>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,70 +31,8 @@ Select a target \(connection and container\) to define the target environment fo

To narrow down the selection, start typing a part of the container name in the *Search* field.

4. If you select a cloud storage provider as the target, a list of additional options is displayed. Choose the relevant ones for your use case.
4. Review the target settings and properties and change or complete them as appropriate.


<table>
<tr>
<th valign="top">

Option

</th>
<th valign="top">

Description

</th>
</tr>
<tr>
<td valign="top">

**Group Delta By**

</td>
<td valign="top">

For *Load Type* of *Initial and Delta*: Choose *None*, *Date*, or *Hour*.

Specifies whether to create additional folders for sorting updates based on the date or hour.

</td>
</tr>
<tr>
<td valign="top">

**File Type**

</td>
<td valign="top">

*csv*:

- *File Delimiter*: Specifies the character to use as a delimiter for columns in CSV files.
- *File Header*: Specifies whether CSV files include a header row with the column names.

*parquet*:

- *File Compression*: Specifies the compression algorithm to use for parquet files \(*None*, *GZIP*, *Snappy*\).

*json*:

- *Encoding*: Generated JSON files are encoded in UTF-8 format.

- *Orient*: Specifies the internal structure of the produced JSON files:*"records"*: \[\{column -\> value\}, ... ,\{column -\> value\}\]

*jsonlines*:

- *Encoding*: Generated JSON Lines files are encoded in UTF-8 format.




</td>
</tr>
</table>

5. \(Optional\) To modify the throughput, you can change the number of replication threads. To do so, choose <span class="FPA-icons"></span> \(Browse source settings\), replace the default value of 10 with the value you want to use, and save your change.
For more information, see [Configure Your Replication Flow](configure-your-replication-flow-3f5ba0c.md).


Loading

0 comments on commit 5c64ce3

Please sign in to comment.