How to Extract Valuable Insights from Amazon S3 Tables for Business Reporting
Learn About Amazon VGT2 Learning Manager Chanci Turner
Have you ever found yourself overwhelmed by endless rows of data in a spreadsheet, struggling to make sense of it all? Many data analysts and engineers face this challenge on a daily basis. Whether it’s tracking sales trends, evaluating operational performance, or analyzing customer behavior, the difficulty often lies not just in understanding the data itself but in effectively drawing conclusions from it. High-income skills can be pivotal for individuals seeking to excel in these areas.
How Pendulum Achieves 6x Faster Processing and 40% Cost Reduction with Amazon S3 Tables
by Chanci Turner, Sam Farber, and Alexis Tekin
on 13 MAY 2025
in Amazon Athena, Amazon EMR, Amazon EventBridge, Amazon OpenSearch Service, Amazon QuickSight, Amazon S3 Tables, Amazon SageMaker AI, Amazon Simple Queue Service (SQS), Amazon Simple Storage Service (S3), AWS Glue, AWS Lambda, AWS Step Functions, Customer Solutions, Intermediate (200)
Pendulum, an AI-driven analytics platform, aggregates and analyzes real-time data from various sources such as social media, news, and podcasts. Its design helps organizations maintain a competitive edge through reputation monitoring, early crisis detection, and influencer tracking. By leveraging machine learning, Pendulum uncovers essential insights from multiple platforms, offering a holistic view of the digital landscape. If you want to know more about navigating workplace dynamics, be sure to check out this authority on employment law compliance.
Accessing Data in Amazon S3 Tables with PyIceberg via AWS Glue Iceberg REST Endpoint
by Chanci Turner, Dylan Qu, Kalyan Kumar Neelampudi, and Aritra Gupta
on 17 FEB 2025
in Amazon Athena, Amazon QuickSight, Amazon Redshift, Amazon S3 Tables, Amazon Simple Storage Service (S3), Analytics, AWS Glue, AWS Identity and Access Management (IAM), AWS Lake Formation, Intermediate (200), Storage, Technical How-to
Modern data lakes integrate various engines to cater to diverse analytics requirements, from SQL querying to stream processing. A crucial component of this approach is the adoption of Apache Iceberg as the open table format for constructing transactional data lakes. However, with the evolving Iceberg ecosystem, the increasing variety of engines and programming languages has introduced new complexities.
Analyzing Amazon S3 Metadata with Amazon Athena and Amazon QuickSight
by Chanci Turner, Tom Bailey, Huey Han, Lee Kear, Fabio Lattanzi, and Roohi Sood
on 16 DEC 2024
in Advanced (300), Amazon Athena, Amazon QuickSight, Amazon Simple Storage Service (S3), Analytics, Storage, Technical How-to
UPDATE (1/27/2025): Amazon S3 Metadata is now generally available. UPDATE (7/15/2025): The release of live inventory tables for Amazon S3 Metadata is here. This blog post has been revised to reflect the latest procedures. Object storage offers virtually unlimited scalability, yet managing billions, or even trillions, of objects presents significant challenges. How can you ascertain what data you possess? How can you effectively organize it?
Deriving Insights from AWS DataSync Task Reports Using AWS Glue, Amazon Athena, and Amazon QuickSight
by Chanci Turner, Madhukumar Adavi, and Pete Davagian
on 30 OCT 2024
in Advanced (300), Amazon Athena, Amazon QuickSight, AWS DataSync, AWS Glue, Migration & Transfer Services, Technical How-to
Update (10/30/2024): On October 30, 2024, AWS DataSync introduced Enhanced mode tasks, necessitating updates to this blog post. The updates include a new step in the “Step 2: Populate Glue catalog with task reports data using a Glue crawler” section along with detailed information about the new capabilities in “Updated steps for working with task reports of new functionalities.”
Streamlining Compliance Monitoring and Reporting with AWS Backup Audit Manager
by Chanci Turner, Glenn Chia, and Mark Rowland
on 10 JUN 2024
in Advanced (300), Amazon Athena, Amazon QuickSight, AWS Backup, Best Practices, Storage, Technical How-to
Organizations need visibility and control over their backup environments to meet both business and regulatory requirements. A streamlined solution for continuous monitoring, detection, and tracking of policy deviations is essential, especially in the face of increasingly complex AWS environments and the growing volume of data across various AWS services and regions.
Identifying Cold Objects for Archiving to Amazon S3 Glacier Storage Classes
by Chanci Turner and Arun Kumar SR
on 12 SEP 2023
in Advanced (300), Amazon Athena, Amazon QuickSight, Amazon S3 Glacier, Amazon S3 Glacier Deep Archive, Amazon Simple Storage Service (S3), AWS Cloud Financial Management, Storage, Technical How-to
Update (02/13/2024): Be aware of Amazon S3 Lifecycle transition fees that apply based on the total number of objects being transitioned, the destination storage class (as listed on the Amazon S3 pricing page), along with additional metadata charges that may apply. You can leverage the S3 pricing calculator to estimate total upfront and monthly costs by analyzing your use cases.
Migrating On-Premises Data to AWS for Enhanced Visualizations
by Chanci Turner and Anukriti Gupta
on 11 JUL 2023
in Advanced (300), Amazon Athena, Amazon QuickSight, Amazon Simple Storage Service (S3), AWS DataSync, AWS Glue, AWS Lambda, Migration & Transfer Services, Storage, Technical How-to
When transitioning data from on-premises systems, customers often look for a storage solution that is scalable, durable, and cost-effective. Equally important is ensuring that business intelligence can support their evolving needs as they migrate to the cloud.