Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Apple store nov 2024 updates #27

Merged
merged 13 commits into from
Feb 20, 2025
5 changes: 4 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,7 @@
# dbt_app_reporting version.version
# dbt_app_reporting v0.5.0

## Breaking Changes
- This package has been upgraded following schema changes upstream in the `dbt_apple_store` package. For more information, refer to the `dbt_apple_store` [release notes](https://github.com/fivetran/dbt_apple_store/releases/tag/v0.5.0).
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you highlight here if any changes other than the upstream dependency switch are expected for the customer here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think there any changes specific to this package. Though I did update the language to highlight that there are breaking changes in the upstream packages referenced.


## Documentation
- Added Quickstart model counts to README. ([#26](https://github.com/fivetran/dbt_app_reporting/pull/26))
Expand Down
2 changes: 1 addition & 1 deletion dbt_project.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
name: 'app_reporting'
version: '0.4.0'
version: '0.5.0'
config-version: 2
models:
app_reporting:
Expand Down
2 changes: 1 addition & 1 deletion docs/catalog.json

Large diffs are not rendered by default.

47 changes: 37 additions & 10 deletions docs/index.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion docs/manifest.json

Large diffs are not rendered by default.

1 change: 0 additions & 1 deletion docs/run_results.json

This file was deleted.

10 changes: 5 additions & 5 deletions integration_tests/ci/sample.profiles.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,13 +16,13 @@ integration_tests:
pass: "{{ env_var('CI_REDSHIFT_DBT_PASS') }}"
dbname: "{{ env_var('CI_REDSHIFT_DBT_DBNAME') }}"
port: 5439
schema: app_reporting_integrations_test_6
schema: app_reporting_integrations_test_9
threads: 8
bigquery:
type: bigquery
method: service-account-json
project: 'dbt-package-testing'
schema: app_reporting_integrations_test_6
schema: app_reporting_integrations_test_9
threads: 8
keyfile_json: "{{ env_var('GCLOUD_SERVICE_KEY') | as_native }}"
snowflake:
Expand All @@ -33,7 +33,7 @@ integration_tests:
role: "{{ env_var('CI_SNOWFLAKE_DBT_ROLE') }}"
database: "{{ env_var('CI_SNOWFLAKE_DBT_DATABASE') }}"
warehouse: "{{ env_var('CI_SNOWFLAKE_DBT_WAREHOUSE') }}"
schema: app_reporting_integrations_test_6
schema: app_reporting_integrations_test_9
threads: 8
postgres:
type: postgres
Expand All @@ -42,13 +42,13 @@ integration_tests:
pass: "{{ env_var('CI_POSTGRES_DBT_PASS') }}"
dbname: "{{ env_var('CI_POSTGRES_DBT_DBNAME') }}"
port: 5432
schema: app_reporting_integrations_test_6
schema: app_reporting_integrations_test_9
threads: 8
databricks:
catalog: "{{ env_var('CI_DATABRICKS_DBT_CATALOG') }}"
host: "{{ env_var('CI_DATABRICKS_DBT_HOST') }}"
http_path: "{{ env_var('CI_DATABRICKS_DBT_HTTP_PATH') }}"
schema: app_reporting_integrations_test_6
schema: app_reporting_integrations_test_9
threads: 8
token: "{{ env_var('CI_DATABRICKS_DBT_TOKEN') }}"
type: databricks
67 changes: 12 additions & 55 deletions integration_tests/dbt_project.yml
Original file line number Diff line number Diff line change
@@ -1,13 +1,14 @@
name: 'app_reporting_integration_tests'
version: '0.4.0'
version: '0.5.0'
profile: 'integration_tests'
config-version: 2
vars:
# apple_store__using_subscriptions: true # uncomment this line when generating docs!
# google_play__using_subscriptions: true # uncomment this line when regenerating docs!
# google_play__using_earnings: true # uncomment this line when regenerating docs!
google_play_schema: app_reporting_integrations_test_6
apple_store_schema: app_reporting_integrations_test_6
google_play_schema: app_reporting_integrations_test_9
apple_store_schema: app_reporting_integrations_test_9

google_play_source:
google_play_stats_installs_app_version_identifier: "stats_installs_app_version"
google_play_stats_crashes_app_version_identifier: "stats_crashes_app_version"
Expand All @@ -28,22 +29,14 @@ vars:
google_play_financial_stats_subscriptions_country_identifier: "financial_stats_subscriptions_country"

apple_store_source:
apple_store_app_identifier: "app"
apple_store_app_store_platform_version_source_type_report_identifier: "app_store_platform_version_source_type"
apple_store_app_store_source_type_device_report_identifier: "app_store_source_type_device"
apple_store_app_store_territory_source_type_report_identifier: "app_store_territory_source_type"
apple_store_crashes_app_version_device_report_identifier: "crashes_app_version"
apple_store_crashes_platform_version_device_report_identifier: "crashes_platform_version"
apple_store_downloads_platform_version_source_type_report_identifier: "downloads_platform_version_source_type"
apple_store_downloads_source_type_device_report_identifier: "downloads_source_type_device"
apple_store_downloads_territory_source_type_report_identifier: "downloads_territory_source_type"
apple_store_sales_account_identifier: "sales_account"
apple_store_sales_subscription_event_summary_identifier: "sales_subscription_events"
apple_store_app_identifier: "app_store_app"
apple_store_sales_subscription_event_summary_identifier: "sales_subscription_event_summary"
apple_store_sales_subscription_summary_identifier: "sales_subscription_summary"
apple_store_usage_app_version_source_type_report_identifier: "usage_app_version_source_type"
apple_store_usage_platform_version_source_type_report_identifier: "usage_platform_version_source_type"
apple_store_usage_source_type_device_report_identifier: "usage_source_type_device"
apple_store_usage_territory_source_type_report_identifier: usage_territory_source_type
apple_store_discovery_and_engagement_standard_daily_identifier: "app_store_discovery_and_engagement_standard_daily"
apple_store_crash_daily_identifier: "app_crash_daily"
apple_store_download_standard_daily_identifier: "app_store_download_standard_daily"
apple_store_session_standard_daily_identifier: "app_session_standard_daily"
apple_store_installation_and_deletion_standard_daily_identifier: "app_store_installation_and_deletion_standard_daily"

apple_store__subscription_events:
- 'Renew'
Expand All @@ -70,40 +63,4 @@ seeds:
active_device_installs: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"
stats_ratings_app_version:
+column_types:
app_version_code: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"
app_store_platform_version_source_type:
+column_types:
date: timestamp
crashes_platform_version:
+column_types:
date: timestamp
crashes_app_version:
+column_types:
date: timestamp
downloads_platform_version_source_type:
+column_types:
date: timestamp
app_store_territory_source_type:
+column_types:
date: timestamp
downloads_source_type_device:
+column_types:
date: timestamp
app_store_source_type_device:
+column_types:
date: timestamp
usage_source_type_device:
+column_types:
date: timestamp
downloads_territory_source_type:
+column_types:
date: timestamp
usage_territory_source_type:
+column_types:
date: timestamp
usage_platform_version_source_type:
+column_types:
date: timestamp
usage_app_version_source_type:
+column_types:
date: timestamp
app_version_code: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"
2 changes: 0 additions & 2 deletions integration_tests/seeds/app.csv

This file was deleted.

11 changes: 11 additions & 0 deletions integration_tests/seeds/app_crash_daily.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
_fivetran_id,app_id,date,app_version,device,platform_version,crashes,unique_devices,_fivetran_synced
mATdTIo1WH34/utbwQZkvLNs6wU=,239587236,2024-12-04,120614,iPhone,iOS 16.4,1,1,2024-12-11 05:13:33.444 +00:00
PYNoHVNnmMuAKBkHqvpL2G6462E=,239587236,2024-12-05,1.3.4,Apple Vision,visionOS 1.0,1,1,2024-12-12 05:14:16.162 +00:00
YKv85Suuzv2jkvVhAyg2F8WM7SY=,239587236,2024-12-05,1242228,iPhone,iOS 17.1,1,1,2024-12-12 05:14:16.173 +00:00
fyzwmTKUa2Rcwyzp7iKJVNwa004=,239587236,2024-12-05,1206422,iPhone,iOS 15.1,1,1,2024-12-12 05:14:16.170 +00:00
rI4nrxlzrGiShj+7lnkVNLA4DdU=,239587236,2024-12-05,120222,iPhone,iOS 17.4,1,1,2024-12-12 05:14:16.166 +00:00
iBFL/ZX+cw+LEb9QzQ0EIDmIsqg=,239587236,2024-12-05,120222.1,iPhone,iOS 17.2,1,1,2024-12-12 05:14:16.189 +00:00
RN7svEING9NuyLcOQkgRgcyPcGc=,239587236,2024-12-05,55555,iPhone,iOS 14.2,1,1,2024-12-12 05:14:16.175 +00:00
WIP6VVo9+T0ptzvWfSChZ+oSK1w=,239587236,2024-12-05,55555.5,iPhone,iOS 17.4,1,1,2024-12-12 05:14:16.157 +00:00
9liOcvJVocUOsGJdywFyCnwiIlg=,239587236,2024-12-06,55554,iPhone,iOS 18.1,1,1,2024-12-13 05:12:19.497 +00:00
ow5NCW34KSFvzijb+vJaiqeZr9c=,239587236,2024-12-06,1,iPhone,iOS 17.5,1,1,2024-12-13 05:12:19.527 +00:00
11 changes: 11 additions & 0 deletions integration_tests/seeds/app_session_standard_daily.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
_fivetran_id,app_id,date,app_version,device,platform_version,source_type,page_type,app_download_date,territory,sessions,total_session_duration,unique_devices,_fivetran_synced
o5wEoLRdDH/NskmQrUaaZBKLaTM=,239587236,2024-11-08,329372.0,iPhone,iOS 17.6,App referrer,Product page,,US,14,797,5,2024-11-13 17:10:45.370 +00:00
z5uCMEdxXVl3h0n+kYepEiVUtvo=,239587236,2024-11-09,120652.0,iPhone,iOS 16.7,App Store search,Product page,,IT,9,898,5,2024-11-14 17:10:29.921 +00:00
VbvXuJhvMfNLeK0uN1kG/9H1K3c=,239587236,2024-11-09,329372.0,iPhone,iOS 18.1,Web referrer,Product page,,TW,23,752,5,2024-11-14 17:10:32.333 +00:00
xq+QCXmwomsV+hoAVUXQ53pVevY=,239587236,2024-11-10,329372.0,iPhone,iOS 17.6,App Store search,No page,2024-11-02,PT,18,306,5,2024-11-15 17:15:52.331 +00:00
Xa6PaV9l8ni0U6VGuNwSNMm7KdU=,239587236,2024-11-10,329372.1,iPhone,iOS 17.4,App Store search,No page,,HK,15,3198,7,2024-11-15 17:15:53.906 +00:00
GF8h2QWP830nj8JLncVlc3ijoqA=,239587236,2024-11-10,329372.1,iPhone,iOS 17.6,App Store search,No page,2024-11-10,IL,20,2873,7,2024-11-15 17:15:53.993 +00:00
kGwZC0OxQTTlblE1X/H4KjUpFv8=,239587236,2024-11-10,120658.0,iPhone,iOS 18.0,App Store search,Product page,,IT,6,76,6,2024-11-15 17:15:51.026 +00:00
NgrBbeUJS4ydIChu1HbkUteIoM4=,239587236,2024-11-10,329372.0,iPhone,iOS 17.5,Web referrer,Product page,,SE,6,358,5,2024-11-15 17:15:52.045 +00:00
iSC24SA4YvjP88OUma5VAuqbAIk=,239587236,2024-11-10,120654.0,iPhone,iOS 16.7,App Store search,No page,,LB,85,15485,5,2024-11-15 17:15:50.794 +00:00
NSjp+2R/xirT0vO4JQMQfWDwEHk=,239587236,2024-11-10,329372.1,iPhone,iOS 17.4,App Store search,No page,,GB,11,385,5,2024-11-15 17:15:53.906 +00:00
2 changes: 2 additions & 0 deletions integration_tests/seeds/app_store_app.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
id,name,primary_locale,content_rights_declaration,was_made_for_kids,subscription_status_url,subscription_status_url_version,subscription_status_url_for_sandbox,subscription_status_url_version_for_sandbox,_fivetran_synced
239587236,Sample,en-US,DOES_NOT_USE_THIRD_PARTY_CONTENT,,https://example.com/subscription_status,v1,https://sandbox.example.com/subscription_status,v2,2022-01-02 12:34:56.789000+00:00
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
_fivetran_id,app_id,date,event,page_type,source_type,engagement_type,device,platform_version,territory,counts,unique_counts,_fivetran_synced
5SJIE4ZfUINJ3AI1T1A5AzRUqLc=,239587236,2024-11-04,Page view,Store sheet,App referrer,,iPhone,iOS 17.4,US,7,5,2024-11-07 17:10:21.652 +00:00
fTN+30viu9DOGf7xi0alJ3h3HMs=,239587236,2024-11-04,Page view,Store sheet,App Store browse,,iPhone,iOS 17.3,US,6,6,2024-11-07 17:10:18.235 +00:00
9zmUs3grlpd8K7mhYs6t0P7GGBc=,239587236,2024-11-04,Page view,Store sheet,App referrer,,iPhone,iOS 18.0,US,5,5,2024-11-07 17:10:21.376 +00:00
Ar8iylQfK9915AfMCqvslNeqbco=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPad,iOS 16.7,FR,5,5,2024-11-08 17:11:38.625 +00:00
vRqeI3eSZtOtBqzLpWvtQXheFDI=,239587236,2024-11-05,Tap,Store sheet,App Store browse,Open,iPhone,iOS 17.6,CA,6,6,2024-11-08 17:11:38.572 +00:00
pvCxArKHnaAFxuZf63/1PYKkiR4=,239587236,2024-11-05,Tap,Store sheet,App Store browse,Open,iPhone,iOS 18.0,GR,5,5,2024-11-08 17:11:40.033 +00:00
6lXCI/W8NqhA3UsQQFvU58cuTZw=,239587236,2024-11-05,Impression,No page,App Store search,,iPhone,iOS 16.6,FR,5,5,2024-11-08 17:11:31.470 +00:00
32rZ60OOHhVps86YhkBS3Z8+BiE=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPhone,iOS 18.1,FR,5,5,2024-11-08 17:11:31.699 +00:00
Gm1Bl6Omn5JN2deWlmUAYpfjc/w=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPhone,iOS 16.7,FR,11,5,2024-11-08 17:11:34.334 +00:00
pK52DqMhmHqf7bp6bWbAV159zDQ=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPhone,iOS 18.0,FR,5,5,2024-11-08 17:11:31.056 +00:00
11 changes: 11 additions & 0 deletions integration_tests/seeds/app_store_download_standard_daily.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
_fivetran_id,app_id,date,download_type,app_version,device,platform_version,source_type,page_type,pre_order,territory,counts,_fivetran_synced
BkesX890oPBVMhTXQ/hiDdx6qtI=,239587236,2024-10-31,Auto-update,329372.0,iPhone,iOS 17.6,Web referrer,Product page,,SI,5,2024-11-02 17:08:18.158 +00:00
0thg2HpfH+pyt51xfqsX2gjBqng=,239587236,2024-10-31,Auto-update,329372.1,Apple TV,tvOS 18.0,Unavailable,Product page,,AU,5,2024-11-02 17:08:23.298 +00:00
lueVOUt20qfGZTy7okfwofpHWEw=,239587236,2024-10-31,Auto-update,329372.0,iPad,iOS 17.7,App referrer,Store sheet,,AU,5,2024-11-02 17:08:21.313 +00:00
jB997hDHmq8fhclBbRLme9x+S2I=,239587236,2024-10-31,Auto-update,329372.1,iPhone,iOS 17.6,Unavailable,Product page,,PT,5,2024-11-02 17:08:24.920 +00:00
4wA7BEsAKZf8NT1FwxQRAi/GfSI=,239587236,2024-10-31,Auto-update,329372.0,iPhone,iOS 18.1,Unavailable,No page,,DE,5,2024-11-02 17:08:20.343 +00:00
eKdeGwYA7mc5y+dG/KIypR37d6U=,239587236,2024-10-31,Auto-update,120652.0,iPad,iOS 18.0,Unavailable,No page,,JP,5,2024-11-02 17:08:18.687 +00:00
Ropru4fq66wJDBlw8uX7S3Y8C3c=,239587236,2024-10-31,Auto-update,329372.0,Apple TV,tvOS 17.2,App Store search,No page,,AU,6,2024-11-02 17:08:23.535 +00:00
O7UP8N94zIg8GGMIx9B+G1NdIso=,239587236,2024-10-31,Auto-update,329372.1,iPad,iOS 16.3,App Store search,No page,,MY,8,2024-11-02 17:08:20.909 +00:00
rHAiOrf6uCyTLOQI83Sp/4U7I3w=,239587236,2024-10-31,Auto-update,120658.0,iPhone,iOS 18.1,App Store browse,No page,,HK,9,2024-11-02 17:08:25.364 +00:00
QP/giakN+TvGdJeYYUri1dZ9eAU=,239587236,2024-10-31,Manual update,120654.0,iPhone,iOS 17.5,Unavailable,No page,,MY,5,2024-11-02 17:08:20.541 +00:00
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
_fivetran_id,app_id,date,event,download_type,app_version,device,platform_version,source_type,page_type,app_download_date,territory,counts,unique_devices,_fivetran_synced
rLTCNO6J9D59i7ffRhp+E5EyleQ=,239587236,2024-11-11,Install,Manual update,329372.0,iPhone,iOS 17.5,Web referrer,Product page,,AU,5,5,2024-11-16 17:09:33.790 +00:00
4NMQBTa2qQSIR9OAJEoekOzqANM=,239587236,2024-11-11,Install,Manual update,329372.1,iPhone,iOS 18.1,App Store browse,No page,2024-10-24,MX,6,6,2024-11-16 17:09:34.269 +00:00
TGwYHBcBQrDPz5kyrHqwRquf2Pc=,239587236,2024-11-12,Install,Manual update,329372.0,iPhone,iOS 18.0,App Store search,No page,,CR,5,5,2024-11-18 05:10:16.445 +00:00
QnICsNy0tjs++YD8Jd/gKnkVqr8=,239587236,2024-11-12,Install,Redownload,329372.1,iPhone,iOS 18.0,App Store browse,No page,2024-11-11,US,12,5,2024-11-18 05:10:17.222 +00:00
4tfCNvQ77h0QLLhbIfilFbxr4Oo=,239587236,2024-11-12,Install,Manual update,329372.1,iPad,iOS 17.7,App Store search,No page,,KR,8,6,2024-11-18 05:10:16.576 +00:00
Vki6Z8OPqh87H8+vc0ISkQ5S9aU=,239587236,2024-11-12,Install,Manual update,329372.0,iPhone,iOS 17.6,Unavailable,No page,,SG,7,7,2024-11-18 05:10:16.424 +00:00
uYwjMGDUKeWHsgF0G6BBREsc8gg=,239587236,2024-11-12,Install,Manual update,329372.1,iPad,iOS 18.0,App Store search,Product page,,US,50,45,2024-11-18 05:10:16.605 +00:00
53TtP8bqpftYRBqkTsZLXsnjG2A=,239587236,2024-11-12,Install,Manual update,329372.1,iPhone,iOS 18.1,Unavailable,No page,,TR,23,20,2024-11-18 05:10:17.173 +00:00
hpZC6khrDuFKOt5BHC8E4yxeunY=,239587236,2024-11-12,Install,Manual update,329372.1,iPad,iOS 17.6,App Store browse,No page,,AU,16,16,2024-11-18 05:10:16.529 +00:00
DjTfw5IHcig1bhl3leRb5SExOis=,239587236,2025-01-27,Delete,,120670.0,iPhone,iOS 18.2,App Store browse,No page,,US,6,6,2025-01-28 17:09:31.693 +00:00
11 changes: 0 additions & 11 deletions integration_tests/seeds/app_store_platform_version_source_type.csv

This file was deleted.

11 changes: 0 additions & 11 deletions integration_tests/seeds/app_store_source_type_device.csv

This file was deleted.

18 changes: 0 additions & 18 deletions integration_tests/seeds/app_store_territory_source_type.csv

This file was deleted.

Loading