English 中文(简体)
在潮 的空中飞行中,为什么要耗费如此多的资源,如果它只是向雪茄发出问询。
原标题:In airflow with dbt, why are tasks consuming so many resources if it just sends queries to snowflake

我在AWSWAA上进行了空中飞行,我们有一个 d干的模式,我们从一个DAG那里呼吁。 关于洗.的询问是针对一个进行截肢的雪茄仓库进行的。 然而,我们的任务跨越了60个并行的子塔,这项任务基本上是为了形成改变参数的争.。

这60项同时执行的任务向我们表明,航空流量的资源应该大幅增加。 我的理解是,同意意味着资源。 然而,在这种情况下,工人和劳动监察署的工作时间比不平行的多倍。

我的问题是:如果雪粉碎仓库是实际加工和空运的仓库,那么,如果它只是发出询问,那么空运为什么需要增加资源? 或者,我在这里的某处错了吗? 空运如何需要多倍的援助团来管理它发出的60个 queries问?

问题回答

我的猜测只是空流,而由于任务结果是从数据来源重新得出的,并且将在以下任务中重新使用,因此,你能够看到援助团的使用增加。

这是一种简单的听器下载过程,这一差额正在下载,是将数据输入磁盘,但空气流没有持续步骤(可能已经),因此,将重复使用的所有数据必须储存在你的RAM中。

希望这一答案将有助于!





相关问题
Mount windows shared drive to MWAA in bootscript

In MWAA startup script sudo yum install samba-client cifs-utils -y sudo mount.cifs //dev/test/drop /mnt/dev/test-o username=testuser,password= pwd ,domain=XX Executing above commonds giving error - ...

How to get Amazon Seller Central orders programmatically?

We have been manually been keying Amazon orders into our system and would like to automate it. However, I can t seem to figure out how to go about it. Their documentation is barely there. There is: ...

Using a CDN like Amazon S3 to control access to media

I want to use Amazon S3/CloudFront to store flash files. These files must be private as they will be accessed by members. This will be done by storing each file with a link to Amazon using a mysql ...

unable to connect to database on AWS

actually I have my website build with Joomla hosted on hostmonster but all Joomla website need a database support to run this database is on AWS configuration files need to be updated for that I ...

Using EC2 Load Balancing with Existing Wordpress Blog

I currently have a virtual dedicated server through Media Temple that I use to run several high traffic Wordpress blogs. Both tend to receive sudden StumbleUpon traffic surges that (I m assuming) ...

SSL slowness in EC2

We ve deployed our rails app to EC2. In our setup, we have two proxies on small instances behind round-robin DNS. These run nginx load balancers for a dynamically growing and shrinking farm of web ...

热门标签