{"id":2153,"date":"2023-04-28T14:05:52","date_gmt":"2023-04-28T05:05:52","guid":{"rendered":"https:\/\/edu.ujhb.org\/?p=2153"},"modified":"2023-04-28T14:05:52","modified_gmt":"2023-04-28T05:05:52","slug":"airflow%e5%85%a5%e9%96%80%ef%bc%88%e6%97%a5%e6%9c%ac%e8%aa%9e%e7%89%88%ef%bc%89","status":"publish","type":"post","link":"https:\/\/edu.ujhb.org\/?p=2153","title":{"rendered":"Airflow\u5165\u9580\uff08\u65e5\u672c\u8a9e\u7248\uff09"},"content":{"rendered":"\n<p>w \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3068\u3044\u304f\u3064\u304b\u306e\u4e00\u822c\u7684\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb \u30ea\u30bd\u30fc\u30b9\u306b\u57fa\u3065\u3044\u3066\u8a2d\u8a08\u3055\u308c\u305f\u30d3\u30c7\u30aa \u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u306e\u6982\u8981\u3067\u3059\u3002\u5404\u30bb\u30af\u30b7\u30e7\u30f3\u306f\u3001\u5fc5\u8981\u306b\u5fdc\u3058\u3066\u8abf\u6574\u3067\u304d\u308b\u500b\u5225\u306e\u30d3\u30c7\u30aa\u3068\u3057\u3066\u6a5f\u80fd\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30b3\u30fc\u30b9\u306e\u8aac\u660e\u3068\u76ee\u7684<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Apache Airflow \u306e\u6982\u8981<\/li>\n\n\n\n<li>\u6c17\u6d41\u306e\u9069\u7528\u30b7\u30ca\u30ea\u30aa<\/li>\n\n\n\n<li>\u30b3\u30fc\u30b9\u6982\u8981\u3068\u76ee\u7684<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30a8\u30a2\u30d5\u30ed\u30fc\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u69cb\u6210<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30b7\u30b9\u30c6\u30e0\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2<\/li>\n\n\n\n<li>pip \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b<\/li>\n\n\n\n<li>Airflow \u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u69cb\u6210\u3059\u308b<\/li>\n\n\n\n<li>Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>Airflow\u57fa\u672c\u6982\u5ff5<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>DAG (\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5)<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af<\/li>\n\n\n\n<li>\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9<\/li>\n\n\n\n<li>\u5b9f\u884c\u8005<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u6700\u521d\u306e Airflow DAG \u3092\u4f5c\u6210\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30b7\u30f3\u30d7\u30eb\u306a DAG \u3092\u4f5c\u6210\u3059\u308b<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b<\/li>\n\n\n\n<li>Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3067\u306e DAG \u306e\u8868\u793a<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>\u7d44\u307f\u8fbc\u307f\u306e\u6f14\u7b97\u5b50\u3092\u4f7f\u7528\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>BashOperator<\/li>\n\n\n\n<li>PythonOperator<\/li>\n\n\n\n<li>BranchOperator<\/li>\n\n\n\n<li>SubDagOperator<\/li>\n\n\n\n<li>\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u4e00\u822c\u7684\u306a\u6f14\u7b97\u5b50<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"6\">\n<li>Airflow \u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u30fc\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u306e\u7d39\u4ecb<\/li>\n\n\n\n<li>LocalExecutor \u3068 CeleryExecutor \u306e\u4f7f\u7528<\/li>\n\n\n\n<li>\u4e26\u5217\u30bf\u30b9\u30af\u3068\u30ea\u30bd\u30fc\u30b9\u5236\u9650\u3092\u69cb\u6210\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"7\">\n<li>\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30c8\u30ea\u30ac\u30fc<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8a2d\u5b9a\u3059\u308b<\/li>\n\n\n\n<li>\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u3092\u4f7f\u7528\u3059\u308b<\/li>\n\n\n\n<li>\u5916\u90e8\u30bf\u30b9\u30af\u30bb\u30f3\u30b5\u30fc<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"8\">\n<li>\u30a8\u30a2\u30d5\u30ed\u30fc\u306e\u5909\u6570\u3068\u63a5\u7d9a<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u5909\u6570\u3092\u7ba1\u7406\u3059\u308b<\/li>\n\n\n\n<li>DAG \u3067\u306e\u5909\u6570\u306e\u4f7f\u7528<\/li>\n\n\n\n<li>\u63a5\u7d9a\u306e\u7ba1\u7406\u3068\u4f7f\u7528<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"9\">\n<li>Airflow XComs (\u30af\u30ed\u30b9\u30bf\u30b9\u30af\u901a\u4fe1)<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>XCom \u306e\u7d39\u4ecb<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u3067 XComs \u3092\u751f\u6210\u3057\u3066\u4f7f\u7528\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"10\">\n<li>Airflow \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068 Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u52d5\u7684\u306b\u751f\u6210\u3059\u308b<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067\u306e Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306e\u4f7f\u7528<\/li>\n\n\n\n<li>Airflow \u30de\u30af\u30ed\u3068\u95a2\u6570<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"11\">\n<li>\u6c17\u6d41\u306e\u76e3\u8996\u3068\u30ed\u30ae\u30f3\u30b0<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u4f7f\u7528\u3057\u305f\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u30ed\u30b0\u3092\u8868\u793a<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u3092\u8a2d\u5b9a\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"12\">\n<li>Airflow \u306e\u5c55\u958b\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u4f7f\u7528Docker\u90e8\u7f72Airflow<\/li>\n\n\n\n<li>Airflow \u30af\u30e9\u30b9\u30bf\u306e\u30c7\u30d7\u30ed\u30a4<\/li>\n\n\n\n<li>Airflow \u306e\u8a8d\u8a3c\u3068\u627f\u8a8d\u3092\u69cb\u6210\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"13\">\n<li>\u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30d7\u30e9\u30b0\u30a4\u30f3\u30b7\u30b9\u30c6\u30e0\u7d39\u4ecb<\/li>\n\n\n\n<li>\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3059\u308b<\/li>\n\n\n\n<li>\u30ab\u30b9\u30bf\u30e0 Operator \u3092 Airflow \u306b\u8ffd\u52a0\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"14\">\n<li>\u30a8\u30a2\u30d5\u30ed\u30fc\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30b3\u30fc\u30c9\u7de8\u6210\u3068\u30e2\u30b8\u30e5\u30fc\u30eb\u5316<\/li>\n\n\n\n<li>\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG \u306e\u4f7f\u7528<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u518d\u8a66\u884c\u30dd\u30ea\u30b7\u30fc<\/li>\n\n\n\n<li>\u9ad8\u53ef\u7528\u6027\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"15\">\n<li>\u30b3\u30fc\u30b9\u306e\u6982\u8981\u3068\u30d5\u30a9\u30ed\u30fc\u30a2\u30c3\u30d7\u306e\u5b66\u7fd2\u30ea\u30bd\u30fc\u30b9<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30b3\u30fc\u30b9\u5185\u5bb9\u306e\u78ba\u8a8d<\/li>\n\n\n\n<li>Airflow \u306e\u4eca\u5f8c\u306e\u958b\u767a\u306b\u3064\u3044\u3066\u8a71\u3057\u5408\u3046<\/li>\n\n\n\n<li>\u95a2\u9023\u3059\u308b\u5b66\u7fd2\u30ea\u30bd\u30fc\u30b9\u3068\u9ad8\u5ea6\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u306e\u63a8\u5968\u4e8b\u9805\u3092\u63d0\u4f9b\u3059\u308b<\/li>\n<\/ul>\n\n\n\n<p>\u3053\u306e\u30a2\u30a6\u30c8\u30e9\u30a4\u30f3\u306f\u4e88\u5099\u7684\u306a\u63d0\u6848\u306b\u3059\u304e\u307e\u305b\u3093\u3002\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u3068 Web \u30b5\u30a4\u30c8\u306e\u30b3\u30f3\u30c6\u30f3\u30c4\u306b\u5fdc\u3058\u3066\u8abf\u6574\u304a\u3088\u3073\u6700\u9069\u5316\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u304c IT \u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb \u30d3\u30c7\u30aa\u306b\u5f79\u7acb\u3064\u3053\u3068\u3092\u9858\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Apache Airflow \u306e\u7d39\u4ecb\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u3053\u306e\u4f1a\u8a71\u3067\u4f7f\u7528\u3055\u308c\u305f\u4ee5\u524d\u306e\u30e2\u30c7\u30eb\u306f\u4f7f\u7528\u3067\u304d\u307e\u305b\u3093\u3002\u6700\u65b0\u306e\u30c7\u30d5\u30a9\u30eb\u30c8 \u30e2\u30c7\u30eb\u306b\u5207\u308a\u66ff\u3048\u307e\u3057\u305f<\/p>\n\n\n\n<p>Apache Airflow \u306b\u3064\u3044\u3066\u8a71\u3059\u3068\u304d\u3001\u79c1\u305f\u3061\u306f\u901a\u5e38\u3001\u305d\u308c\u3092\u5206\u6563\u578b\u306e\u30d7\u30ed\u30b0\u30e9\u30e0\u53ef\u80fd\u306a\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u7ba1\u7406\u30b7\u30b9\u30c6\u30e0\u3068\u8868\u73fe\u3057\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u8907\u96d1\u306a\u30c7\u30fc\u30bf \u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3001ETL (\u62bd\u51fa\u3001\u5909\u63db\u3001\u8aad\u307f\u8fbc\u307f) \u30d7\u30ed\u30bb\u30b9\u3001\u6a5f\u68b0\u5b66\u7fd2\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3001\u904b\u7528\u30bf\u30b9\u30af\u3001\u304a\u3088\u3073\u8907\u6570\u306e\u30b7\u30b9\u30c6\u30e0\u3068\u30b5\u30fc\u30d3\u30b9\u306b\u308f\u305f\u308b\u305d\u306e\u4ed6\u306e\u81ea\u52d5\u5316\u3055\u308c\u305f\u30d7\u30ed\u30bb\u30b9\u3092\u4f5c\u6210\u3001\u8a08\u753b\u3001\u304a\u3088\u3073\u76e3\u8996\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306e\u4e3b\u306a\u5229\u70b9\u306f\u3001\u3053\u308c\u3089\u306e\u30bf\u30b9\u30af\u3068\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u7ba1\u7406\u3059\u308b\u305f\u3081\u306e\u30d7\u30ed\u30b0\u30e9\u30e0\u53ef\u80fd\u3067\u62e1\u5f35\u53ef\u80fd\u306a\u65b9\u6cd5\u3092\u63d0\u4f9b\u3059\u308b\u3053\u3068\u3067\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f Python \u8a00\u8a9e\u3092\u4f7f\u7528\u3057\u3066\u518d\u5229\u7528\u53ef\u80fd\u306a\u30bf\u30b9\u30af\u3068\u6f14\u7b97\u5b50\u3092\u4f5c\u6210\u3057\u3001\u305d\u308c\u3089\u3092 DAG (\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5) \u306b\u57fa\u3065\u304f\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306b\u7d44\u307f\u5408\u308f\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u3053\u306e\u30a2\u30d7\u30ed\u30fc\u30c1\u306b\u3088\u308a\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u9806\u5e8f\u3001\u4f9d\u5b58\u95a2\u4fc2\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u67d4\u8edf\u306b\u5b9a\u7fa9\u3067\u304d\u308b\u3068\u540c\u6642\u306b\u3001Airflow \u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u30fc\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u5229\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u304c\u4e88\u5b9a\u3069\u304a\u308a\u306b\u5b8c\u4e86\u3057\u3001\u30bf\u30b9\u30af\u306e\u7af6\u5408\u304c\u767a\u751f\u3057\u306a\u3044\u3088\u3046\u306b\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306f\u3001\u30d3\u30b8\u30e5\u30a2\u30eb \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3001\u30d7\u30e9\u30b0\u30a4\u30f3\u53ef\u80fd\u306a\u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u3001\u5f37\u529b\u306a XCom (\u30af\u30ed\u30b9\u30bf\u30b9\u30af\u901a\u4fe1) \u30e1\u30ab\u30cb\u30ba\u30e0\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u3001\u30bf\u30b9\u30af\u306e\u5931\u6557\u306e\u51e6\u7406\u3001\u76e3\u8996\u3068\u30a2\u30e9\u30fc\u30c8\u306a\u3069\u3001\u4ed6\u306e\u591a\u304f\u306e\u6a5f\u80fd\u3068\u30c4\u30fc\u30eb\u3082\u63d0\u4f9b\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u306e\u7ba1\u7406\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002\u30bf\u30b9\u30af\u3068\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u76e3\u8996\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306f Airbnb \u306b\u3088\u3063\u3066\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u5316\u3055\u308c\u3066\u304a\u308a\u3001Apache Software Foundation \u306b\u8ca2\u732e\u3057\u3066\u3044\u307e\u3059\u3002\u73fe\u5728\u3001\u305d\u308c\u306f\u4eba\u6c17\u306e\u3042\u308b\u30aa\u30fc\u30d7\u30f3 \u30bd\u30fc\u30b9 \u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u306b\u306a\u308a\u3001\u591a\u304f\u306e\u5927\u898f\u6a21\u306a\u7d44\u7e54\u3084\u4f01\u696d\u3067\u5e83\u304f\u4f7f\u7528\u3055\u308c\u3001\u63a8\u9032\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow\u306e\u9069\u7528\u30b7\u30ca\u30ea\u30aa\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Apache Airflow \u3092\u4f7f\u7528\u3057\u3066\u3001\u3055\u307e\u3056\u307e\u306a\u7a2e\u985e\u306e\u30c7\u30fc\u30bf\u51e6\u7406\u3001ETL\u3001\u6a5f\u68b0\u5b66\u7fd2\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3001\u30c7\u30fc\u30bf \u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3001\u904b\u7528\u30bf\u30b9\u30af\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u81ea\u52d5\u5316\u3055\u308c\u305f\u30d7\u30ed\u30bb\u30b9\u3092\u7ba1\u7406\u304a\u3088\u3073\u81ea\u52d5\u5316\u3067\u304d\u307e\u3059\u3002\u4e00\u822c\u7684\u306a Airflow \u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306e\u30b7\u30ca\u30ea\u30aa\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30c7\u30fc\u30bf\u51e6\u7406\u3068 ETL Airflow \u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u8907\u96d1\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u3068 ETL \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u7ba1\u7406\u304a\u3088\u3073\u81ea\u52d5\u5316\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002DAG \u3092\u5b9a\u7fa9\u3059\u308b\u3053\u3068\u3067\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30bf\u30b9\u30af\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u306e\u5b9f\u884c\u9806\u5e8f\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u3057\u306a\u304c\u3089\u3001Airflow \u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u30fc\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u304c\u4e88\u5b9a\u3069\u304a\u308a\u306b\u5b8c\u4e86\u3057\u3001\u30bf\u30b9\u30af\u306e\u7af6\u5408\u304c\u767a\u751f\u3057\u306a\u3044\u3088\u3046\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002Airflow \u306f\u3001Hadoop\u3001Spark\u3001Hive\u3001SQLAlchemy\u3001PostgreSQL\u3001MySQL \u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf \u30bd\u30fc\u30b9\u3068\u30c7\u30fc\u30bf \u30b9\u30c8\u30a2\u3082\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u6a5f\u68b0\u5b66\u7fd2\u30ef\u30fc\u30af\u30d5\u30ed\u30fc Airflow \u306f\u3001\u30c7\u30fc\u30bf\u306e\u524d\u51e6\u7406\u3001\u7279\u5fb4\u91cf\u30a8\u30f3\u30b8\u30cb\u30a2\u30ea\u30f3\u30b0\u3001\u30e2\u30c7\u30eb \u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3001\u30e2\u30c7\u30eb\u8a55\u4fa1\u3001\u30c7\u30d7\u30ed\u30a4\u306a\u3069\u3001\u8907\u96d1\u306a\u6a5f\u68b0\u5b66\u7fd2\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u30e6\u30fc\u30b6\u30fc\u304c\u7ba1\u7406\u304a\u3088\u3073\u81ea\u52d5\u5316\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f Python \u3092\u4f7f\u7528\u3057\u3066\u30ab\u30b9\u30bf\u30e0 \u30bf\u30b9\u30af\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3092\u4f5c\u6210\u3057\u3001Airflow \u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3057\u3066\u3053\u308c\u3089\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u7ba1\u7406\u304a\u3088\u3073\u76e3\u8996\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf \u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3068\u30c7\u30fc\u30bf\u30d5\u30ed\u30fc Airflow \u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u30c7\u30fc\u30bf \u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3068\u30c7\u30fc\u30bf\u30d5\u30ed\u30fc\u306e\u51e6\u7406\u3092\u7ba1\u7406\u304a\u3088\u3073\u81ea\u52d5\u5316\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f\u3001Airflow \u3092\u4f7f\u7528\u3057\u3066\u5b9f\u884c\u30b7\u30fc\u30b1\u30f3\u30b9\u3068\u30c7\u30fc\u30bf\u51e6\u7406\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3057\u3001Airflow \u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u3092\u4f7f\u7528\u3057\u3066\u3001\u3055\u307e\u3056\u307e\u306a\u30b7\u30b9\u30c6\u30e0\u3068\u30b5\u30fc\u30d3\u30b9\u306e\u9593\u3067\u30c7\u30fc\u30bf\u304c\u6642\u9593\u3069\u304a\u308a\u306b\u6d41\u308c\u308b\u3088\u3046\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>O&amp;M \u30bf\u30b9\u30af\u3068\u81ea\u52d5\u5316\u30d7\u30ed\u30bb\u30b9 Airflow \u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u30b7\u30b9\u30c6\u30e0\u76e3\u8996\u3001\u30a2\u30e9\u30fc\u30e0\u3001\u30ed\u30b0\u5206\u6790\u3001\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u30ea\u30ab\u30d0\u30ea\u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a O&amp;M \u30bf\u30b9\u30af\u3068\u81ea\u52d5\u5316\u30d7\u30ed\u30bb\u30b9\u3092\u7ba1\u7406\u304a\u3088\u3073\u81ea\u52d5\u5316\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f Python \u3092\u4f7f\u7528\u3057\u3066\u30ab\u30b9\u30bf\u30e0 \u30bf\u30b9\u30af\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3092\u4f5c\u6210\u3057\u3001Airflow \u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3057\u3066\u3053\u308c\u3089\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u7ba1\u7406\u304a\u3088\u3073\u76e3\u8996\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u305d\u306e\u4ed6\u306e\u81ea\u52d5\u5316\u3055\u308c\u305f\u30d7\u30ed\u30bb\u30b9 \u4e0a\u8a18\u306e\u30b7\u30ca\u30ea\u30aa\u306b\u52a0\u3048\u3066\u3001Airflow \u306f\u3001\u30c7\u30fc\u30bf\u306e\u30af\u30ea\u30fc\u30cb\u30f3\u30b0\u3001\u30c7\u30fc\u30bf\u306e\u5909\u63db\u3001\u30c7\u30fc\u30bf\u306e\u8aad\u307f\u8fbc\u307f\u3001\u30c7\u30fc\u30bf\u306e\u7d71\u5408\u3001\u30c7\u30fc\u30bf\u306e\u79fb\u884c\u306a\u3069\u3001\u4ed6\u306e\u3055\u307e\u3056\u307e\u306a\u81ea\u52d5\u5316\u3055\u308c\u305f\u30d7\u30ed\u30bb\u30b9\u306b\u3082\u9069\u7528\u3067\u304d\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f Python \u3092\u4f7f\u7528\u3057\u3066\u30ab\u30b9\u30bf\u30e0 \u30bf\u30b9\u30af\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3092\u4f5c\u6210\u3057\u3001Airflow \u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3057\u3066\u3053\u308c\u3089\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u7ba1\u7406\u304a\u3088\u3073\u76e3\u8996\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u306f\u3001\u8907\u96d1\u306a\u30bf\u30b9\u30af\u3068\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u7ba1\u7406\u304a\u3088\u3073\u81ea\u52d5\u5316\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u3042\u3089\u3086\u308b\u30b7\u30ca\u30ea\u30aa\u306b\u9069\u7528\u3067\u304d\u3001\u3053\u308c\u3089\u306e\u30bf\u30b9\u30af\u3068\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u7ba1\u7406\u3059\u308b\u305f\u3081\u306e\u30d7\u30ed\u30b0\u30e9\u30e0\u53ef\u80fd\u3067\u62e1\u5f35\u53ef\u80fd\u306a\u65b9\u6cd5\u3092\u63d0\u4f9b\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u3088\u308a\u9069\u5207\u306b\u7ba1\u7406\u304a\u3088\u3073\u76e3\u8996\u3059\u308b\u306e\u306b\u5f79\u7acb\u3064\u8c4a\u5bcc\u306a\u6a5f\u80fd\u3068\u30c4\u30fc\u30eb\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002\u30bf\u30b9\u30af\u3068\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u69cb\u6210\u306e\u30b7\u30b9\u30c6\u30e0\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u69cb\u6210\u3059\u308b\u306b\u306f\u3001\u6b21\u306e\u30b7\u30b9\u30c6\u30e0\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2\u306b\u5f93\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30b7\u30b9\u30c6\u30e0\u8981\u6c42<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u306f Linux\u3001macOS\u3001Windows \u3067\u306e\u5b9f\u884c\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u304c\u3001Linux \u3067\u306e\u5b9f\u884c\u304c\u6700\u3082\u4e00\u822c\u7684\u3067\u3059\u3002<\/li>\n\n\n\n<li>\u4f9d\u5b58\u95a2\u4fc2\u306e\u7af6\u5408\u3084\u305d\u306e\u4ed6\u306e\u30b7\u30b9\u30c6\u30e0\u306e\u554f\u984c\u3092\u6700\u5c0f\u9650\u306b\u6291\u3048\u308b\u305f\u3081\u306b\u3001Ubuntu\u3001Debian\u3001CentOS\u3001RHEL \u306a\u3069\u306e\u4e00\u822c\u7684\u306a Linux \u30c7\u30a3\u30b9\u30c8\u30ea\u30d3\u30e5\u30fc\u30b7\u30e7\u30f3\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b7\u30b9\u30c6\u30e0\u306b\u306f\u3001Airflow \u306e\u901a\u5e38\u306e\u52d5\u4f5c\u3068\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u4fdd\u8a3c\u3059\u308b\u305f\u3081\u306b\u3001\u5c11\u306a\u304f\u3068\u3082 2 GB \u306e\u30e1\u30e2\u30ea\u30012 GB \u306e\u30c7\u30a3\u30b9\u30af\u5bb9\u91cf\u3001\u304a\u3088\u3073\u5341\u5206\u306a CPU \u3068\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u5e2f\u57df\u5e45\u304c\u5fc5\u8981\u3067\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u983c\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u306f\u3001Python 3.x \u30d0\u30fc\u30b8\u30e7\u30f3\u3068\u4e00\u90e8\u306e Python \u30e9\u30a4\u30d6\u30e9\u30ea\u304a\u3088\u3073\u30c4\u30fc\u30eb\u306b\u4f9d\u5b58\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>Python \u74b0\u5883\u3092\u7ba1\u7406\u3059\u308b\u306b\u306f\u3001Anaconda\u3001Miniconda\u3001\u307e\u305f\u306f\u4eee\u60f3\u74b0\u5883\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u6700\u65b0\u306e\u6a5f\u80fd\u3068\u4fee\u6b63\u3092\u78ba\u5b9f\u306b\u5165\u624b\u3059\u308b\u306b\u306f\u3001Airflow \u306e\u6700\u65b0\u306e\u5b89\u5b9a\u7248\u30ea\u30ea\u30fc\u30b9\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u4e00\u822c\u7684\u306a Airflow \u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5fc5\u8981\u306a\u4f9d\u5b58\u95a2\u4fc2: apache-airflow\u3001psutil\u3001setuptools\u3001pandas\u3001pytz\u3001pyOpenSSL \u306a\u3069\u3002<\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u4f9d\u5b58\u95a2\u4fc2: Airflow \u306f\u3001SQLite\u3001MySQL\u3001PostgreSQL\u3001Oracle \u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f\u3001\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u9069\u5207\u306a\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u9078\u629e\u3057\u3001\u5bfe\u5fdc\u3059\u308b Python \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9 \u30c9\u30e9\u30a4\u30d0\u30fc\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Executor \u306e\u4f9d\u5b58\u95a2\u4fc2: Airflow \u306f\u3001LocalExecutor\u3001CeleryExecutor\u3001DaskExecutor\u3001KubernetesExecutor \u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a Executor \u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f\u3001\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u9069\u5207\u306a\u30a2\u30af\u30c1\u30e5\u30a8\u30fc\u30bf\u3092\u9078\u629e\u3057\u3001\u5bfe\u5fdc\u3059\u308b\u4f9d\u5b58\u95a2\u4fc2\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u69cb\u6210\u3059\u308b\u524d\u306b\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30b7\u30b9\u30c6\u30e0\u304c\u4e0a\u8a18\u306e\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u6e80\u305f\u3057\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3057\u3001\u5b9f\u969b\u306e\u72b6\u6cc1\u306b\u5fdc\u3058\u3066\u8abf\u6574\u304a\u3088\u3073\u6700\u9069\u5316\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30e1\u30e2\u30ea\u3092\u5897\u3084\u3057\u305f\u308a\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u306e\u69cb\u6210\u3092\u8abf\u6574\u3057\u305f\u308a\u3001Docker \u3092\u4f7f\u7528\u3057\u305f\u308a\u3059\u308b\u3053\u3068\u3067\u3001\u30b7\u30b9\u30c6\u30e0\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u4fe1\u983c\u6027\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u8a2d\u5b9a\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u3092 pip \u3067\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059<\/p>\n\n\n\n<p>pip \u3092\u4f7f\u7528\u3057\u305f Apache Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u306f\u3001\u6700\u3082\u7c21\u5358\u3067\u6700\u3082\u4e00\u822c\u7684\u306a\u65b9\u6cd5\u306e 1 \u3064\u3067\u3059\u3002\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u624b\u9806\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Python \u3068 pip \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u524d\u306b\u3001Python \u3068 pip \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u6700\u65b0\u306e\u6a5f\u80fd\u3068\u4fee\u6b63\u3092\u53d6\u5f97\u3059\u308b\u306b\u306f\u3001Python 3.x \u30d0\u30fc\u30b8\u30e7\u30f3\u3068\u6700\u65b0\u306e pip \u30d0\u30fc\u30b8\u30e7\u30f3\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30a8\u30a2\u30d5\u30ed\u30fc\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9\u30e9\u30a4\u30f3 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u958b\u304d\u3001\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066 Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>pip install apache-airflow\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u7279\u5b9a\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u306e Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u5834\u5408\u306f\u3001\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">php\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>pip install apache-airflow==&lt;version&gt;\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u3053\u308c\u306b\u3088\u308a\u3001PyPI \u304b\u3089 Airflow \u3068\u305d\u306e\u4f9d\u5b58\u95a2\u4fc2\u304c\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3055\u308c\u3001\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u305f\u3089\u3001Airflow \u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">csharp\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow db init\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u3053\u308c\u306b\u3088\u308a\u3001Airflow \u306e\u30e1\u30bf\u30d9\u30fc\u30b9\u304c\u4f5c\u6210\u3055\u308c\u3001\u305d\u306e\u4e2d\u306b\u5fc5\u8981\u306a\u30c6\u30fc\u30d6\u30eb\u3068\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u304c\u4f5c\u6210\u3055\u308c\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>Airflow \u30a6\u30a7\u30d6\u30b5\u30fc\u30d0\u30fc\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3092\u8d77\u52d5\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066\u3001Airflow \u30a6\u30a7\u30d6\u30b5\u30fc\u30d0\u30fc\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">css\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow webserver --port 8080\nairflow scheduler\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u3053\u308c\u306b\u3088\u308a\u3001Airflow \u30a6\u30a7\u30d6\u30b5\u30fc\u30d0\u30fc\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u304c\u8d77\u52d5\u3057\u3001\u30a6\u30a7\u30d6 \u30ea\u30af\u30a8\u30b9\u30c8\u3092\u30dd\u30fc\u30c8 8080 \u3067\u30ed\u30fc\u30ab\u30eb\u306b\u30ea\u30c3\u30b9\u30f3\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30d6\u30e9\u30a6\u30b6\u306b\u6b21\u306e URL \u3092\u5165\u529b\u3057\u3066\u3001Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306b\u30a2\u30af\u30bb\u30b9\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">arduino\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>http:\/\/localhost:8080\/\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u3053\u308c\u306b\u3088\u308a\u3001DAG\u3001\u30bf\u30b9\u30af\u3001\u30ed\u30b0\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u8981\u7d20\u3092\u7ba1\u7406\u304a\u3088\u3073\u76e3\u8996\u3067\u304d\u308b Airflow \u306e Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u304c\u958b\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u4e88\u9632\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u524d\u306b\u3001\u30b7\u30b9\u30c6\u30e0\u304c\u30b7\u30b9\u30c6\u30e0\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u6e80\u305f\u3057\u3066\u3044\u308b\u3053\u3068\u3001\u304a\u3088\u3073\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u304c\u521d\u671f\u5316\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u958b\u59cb\u3059\u308b\u524d\u306b\u3001\u30b7\u30b9\u30c6\u30e0\u304c\u30b7\u30b9\u30c6\u30e0\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u6e80\u305f\u3057\u3066\u3044\u308b\u3053\u3068\u3001\u304a\u3088\u3073\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u304c\u521d\u671f\u5316\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u524d\u306b\u3001\u30a6\u30a7\u30d6\u30b5\u30fc\u30d0\u30fc\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3092\u8d77\u52d5\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u307e\u305f\u3001\u7559\u610f\u3059\u3079\u304d\u70b9\u304c\u3044\u304f\u3064\u304b\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u3068\u304d\u306f\u3001\u4f9d\u5b58\u95a2\u4fc2\u306e\u7af6\u5408\u3084\u30b7\u30b9\u30c6\u30e0\u6c5a\u67d3\u3092\u56de\u907f\u3059\u308b\u305f\u3081\u306b\u3001\u4eee\u60f3\u74b0\u5883\u307e\u305f\u306f\u30b3\u30f3\u30c6\u30ca\u5316\u30c6\u30af\u30ce\u30ed\u30b8\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>pip \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u5834\u5408\u306f\u3001Airflow \u304c\u30b7\u30b9\u30c6\u30e0 \u30ec\u30d9\u30eb\u306e\u5834\u6240\u3067\u306f\u306a\u304f\u30e6\u30fc\u30b6\u30fc \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u308b\u3088\u3046\u306b\u3001<code>--user<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002<\/li>\n\n\n\n<li>pip \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u5834\u5408\u306f\u3001Airflow \u306e\u5b9f\u884c\u6642\u306e\u30a8\u30af\u30b9\u30da\u30ea\u30a8\u30f3\u30b9\u3068\u6a5f\u80fd\u3092\u5411\u4e0a\u3055\u305b\u308b\u305f\u3081\u306b\u3001\u8ffd\u52a0\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001<code>apache-airflow[postgres]<\/code>\u3084 \u306a\u3069\u306e<code>apache-airflow[mysql]<\/code>PostgreSQL \u307e\u305f\u306f MySQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u30b5\u30dd\u30fc\u30c8\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u69cb\u6210\u3059\u308b\u3068\u304d\u306f\u3001\u6700\u65b0\u306e\u5b89\u5b9a\u3057\u305f\u30d0\u30fc\u30b8\u30e7\u30f3\u3092\u4f7f\u7528\u3057\u3001\u66f4\u65b0\u3068\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u3092\u7d9a\u3051\u3066\u6700\u65b0\u306e\u6a5f\u80fd\u3068\u4fee\u6b63\u3092\u53d6\u5f97\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u30a6\u30a7\u30d6\u30b5\u30fc\u30d0\u30fc\u3092\u8d77\u52d5\u3059\u308b\u3068\u304d\u306b\u3001<code>-D<\/code>\u307e\u305f\u306f<code>--daemon<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u4f7f\u7528\u3057\u3066\u30c7\u30fc\u30e2\u30f3 \u30d7\u30ed\u30bb\u30b9\u3068\u3057\u3066\u5b9f\u884c\u3057\u3001<code>-pid<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u3092PID \u30d5\u30a1\u30a4\u30eb\u306e\u5834\u6240\u3092\u6307\u5b9a\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001Web \u30b5\u30fc\u30d0\u30fc\u304c\u30d0\u30c3\u30af\u30b0\u30e9\u30a6\u30f3\u30c9\u3067\u5b9f\u884c\u3055\u308c\u7d9a\u3051\u3001\u7c21\u5358\u306b\u505c\u6b62\u304a\u3088\u3073\u518d\u8d77\u52d5\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3092\u5b9f\u884c\u3059\u308b\u5834\u5408\u3001<code>-n<\/code>\u307e\u305f\u306f<code>--num_runs<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u4f7f\u7528\u3057\u3066\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u304c\u7d42\u4e86\u3059\u308b\u524d\u306b\u5b9f\u884c\u3059\u308b DAG \u306e\u6700\u5927\u6570\u3092\u6307\u5b9a\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u3042\u307e\u308a\u306b\u3082\u591a\u304f\u306e DAG \u3092\u5b9f\u884c\u3059\u308b\u3068\u304d\u306b\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u304c\u30b7\u30b9\u30c6\u30e0 \u30ea\u30bd\u30fc\u30b9\u3068\u6642\u9593\u3092\u6d88\u8cbb\u3057\u3059\u304e\u308b\u306e\u3092\u9632\u3050\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u6700\u9ad8\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u4fe1\u983c\u6027\u3092\u5f97\u308b\u305f\u3081\u306b\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u5f93\u3046\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001DAG \u30ad\u30e3\u30c3\u30b7\u30e5\u3092\u4f7f\u7528\u3057\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u30fc\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u5408\u7406\u7684\u306b\u8a2d\u5b9a\u3057\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u3068\u30bf\u30a4\u30e0\u30a2\u30a6\u30c8\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u5408\u7406\u7684\u306b\u8a2d\u5b9a\u3057\u3001\u904e\u5ea6\u306b\u8907\u96d1\u306a DAG \u307e\u305f\u306f\u30bf\u30b9\u30af\u69cb\u9020\u306e\u4f7f\u7528\u3092\u907f\u3051\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u6a29\u9650\u7ba1\u7406\u306b\u3082\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u304c\u63d0\u4f9b\u3059\u308b\u8a8d\u8a3c\u304a\u3088\u3073\u627f\u8a8d\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u30e6\u30fc\u30b6\u30fc\u3068\u30b0\u30eb\u30fc\u30d7\u306e\u30a2\u30af\u30bb\u30b9\u6a29\u3068\u5b9f\u884c\u6a29\u9650\u3092\u30bf\u30b9\u30af\u3068 DAG \u306b\u5236\u9650\u3057\u3001Airflow \u304c\u63d0\u4f9b\u3059\u308b\u6697\u53f7\u5316\u3068\u8a8d\u8a3c\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u3068\u30c7\u30fc\u30bf\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u4fdd\u8b77\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30ed\u30ae\u30f3\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u306b\u3082\u6ce8\u610f\u3092\u6255\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u304c\u63d0\u4f9b\u3059\u308b\u30ed\u30b0 \u30b7\u30b9\u30c6\u30e0\u3068\u76e3\u8996\u30b7\u30b9\u30c6\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001DAG \u3068\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u8a18\u9332\u304a\u3088\u3073\u8ffd\u8de1\u3057\u3001ELK\u3001Prometheus\u3001Grafana \u306a\u3069\u306e\u30b5\u30fc\u30c9\u30d1\u30fc\u30c6\u30a3\u306e\u30c4\u30fc\u30eb\u3068\u30b5\u30fc\u30d3\u30b9\u3092\u4f7f\u7528\u3057\u3066\u3001\u3088\u308a\u591a\u304f\u306e\u3053\u3068\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002 -\u6df1\u5ea6\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3068 Airflow \u306e\u52d5\u4f5c\u306e\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3002\u5206\u6790\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3068\u9ad8\u53ef\u7528\u6027\u3082\u8003\u616e\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u304c\u63d0\u4f9b\u3059\u308b\u62e1\u5f35\u6a5f\u69cb\u3068\u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u3092\u4f7f\u7528\u3057\u3066\u30ab\u30b9\u30bf\u30e0 \u30bf\u30b9\u30af\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3092\u8ffd\u52a0\u3057\u3001\u30b3\u30f3\u30c6\u30ca\u5316\u6280\u8853\u3068\u30af\u30e9\u30a6\u30c9 \u30cd\u30a4\u30c6\u30a3\u30d6\u6280\u8853\u3092\u4f7f\u7528\u3057\u3066\u3001\u5f3e\u529b\u7684\u3067\u4fe1\u983c\u6027\u306e\u9ad8\u3044 Airflow \u74b0\u5883\u3092\u69cb\u7bc9\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6700\u5f8c\u306b\u3001Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30d0\u30fc\u30b8\u30e7\u30f3\u7ba1\u7406\u3068\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u306b\u3082\u6ce8\u610f\u3092\u6255\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u306f\u65b0\u3057\u3044\u30d0\u30fc\u30b8\u30e7\u30f3\u3068\u30d1\u30c3\u30c1\u3092\u983b\u7e41\u306b\u30ea\u30ea\u30fc\u30b9\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b\u305f\u3081\u3001Git \u306a\u3069\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u7ba1\u7406\u30b7\u30b9\u30c6\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001Airflow \u306e\u30b3\u30fc\u30c9\u3068\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3092\u7ba1\u7406\u304a\u3088\u3073\u8ffd\u8de1\u3057\u3001\u6700\u65b0\u306e\u5b89\u5b9a\u3057\u305f\u30d0\u30fc\u30b8\u30e7\u30f3\u306b\u9069\u6642\u306b\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u3059\u308b\u3053\u3068\u3092\u304a\u52e7\u3081\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u3064\u307e\u308a\u3001pip \u3092\u4f7f\u7528\u3057\u3066 Apache Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u306e\u306f\u7c21\u5358\u3067\u4fbf\u5229\u306a\u65b9\u6cd5\u3067\u3042\u308a\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u3044\u304f\u3064\u304b\u306e\u7c21\u5358\u306a\u624b\u9806\u3067\u81ea\u5206\u306e\u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc\u306b Airflow \u74b0\u5883\u3092\u3059\u3070\u3084\u304f\u69cb\u7bc9\u3067\u304d\u307e\u3059\u3002\u3057\u304b\u3057\u540c\u6642\u306b\u3001\u30b7\u30b9\u30c6\u30e0\u8981\u4ef6\u3068\u4f9d\u5b58\u95a2\u4fc2\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u6a29\u9650\u306e\u7ba1\u7406\u3001\u30ed\u30ae\u30f3\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3001\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3068\u9ad8\u53ef\u7528\u6027\u306a\u3069\u306b\u3082\u6ce8\u610f\u3092\u6255\u3044\u3001Airflow \u306e\u6b63\u5e38\u306a\u52d5\u4f5c\u3068\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u78ba\u4fdd\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u69cb\u6210\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u69cb\u6210\u3059\u308b<\/p>\n\n\n\n<p>Airflow \u3092\u4f7f\u7528\u3059\u308b\u524d\u306b\u3001\u307e\u305a Airflow \u306e\u30e1\u30bf\u30c7\u30fc\u30bf \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u69cb\u6210\u3057\u3066\u3001Airflow \u304c DAG\u3001\u30bf\u30b9\u30af\u3001\u30ed\u30b0\u306a\u3069\u306e\u30e1\u30bf\u30c7\u30fc\u30bf\u60c5\u5831\u3092\u4fdd\u5b58\u304a\u3088\u3073\u7ba1\u7406\u3067\u304d\u308b\u3088\u3046\u306b\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u69cb\u6210\u3059\u308b\u624b\u9806\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u9078\u629e Airflow \u306f\u3001SQLite\u3001MySQL\u3001PostgreSQL\u3001Oracle \u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u30e6\u30fc\u30b6\u30fc\u306f\u3001\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u9069\u5207\u306a\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002\u3053\u3053\u3067\u306f SQLite \u3092\u4f8b\u306b\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u4f5c\u6210 SQLite \u3092\u4f7f\u7528\u3057\u3066\u3044\u308b\u5834\u5408\u3001Airflow \u306f\u81ea\u52d5\u7684\u306b SQLite \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9 \u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u4ed6\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u6700\u521d\u306b\u7a7a\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u4f5c\u6210\u3057\u3001Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u60c5\u5831\u3092\u69cb\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30e1\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u306e\u69cb\u6210 Airflow \u306e\u69cb\u6210\u30d5\u30a1\u30a4\u30eb<code>airflow.cfg<\/code>\u306b\u306f\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u63a5\u7d9a\u60c5\u5831\u3092\u69cb\u6210\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b<code>core<\/code>\u3044\u304f\u3064\u304b\u306e<code>sql_alchemy_conn<\/code>\u69cb\u6210\u9805\u76ee\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001SQLite \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001\u3053\u306e\u69cb\u6210\u9805\u76ee\u3092\u6b21\u306e\u3088\u3046\u306b\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">ruby\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>sql_alchemy_conn = sqlite:\/\/\/\/home\/user\/airflow\/airflow.db\n<\/code><\/pre>\n\n\n\n<p><code>\/\/\/\/<\/code>\u5f8c\u306e\u30d1\u30b9\u306f\u3001SQLite \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9 \u30d5\u30a1\u30a4\u30eb\u306e\u30d1\u30b9\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u521d\u671f\u5316 \u30e1\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u60c5\u5831\u3092\u69cb\u6210\u3057\u305f\u3089\u3001\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066\u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">csharp\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow db init\n<\/code><\/pre>\n\n\n\n<p>\u3053\u308c\u306b\u3088\u308a\u3001Airflow \u306e\u30e1\u30bf\u30d9\u30fc\u30b9\u304c\u4f5c\u6210\u3055\u308c\u3001\u305d\u306e\u4e2d\u306b\u5fc5\u8981\u306a\u30c6\u30fc\u30d6\u30eb\u3068\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u304c\u4f5c\u6210\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9 \u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u5834\u5408\u306f\u3001\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow db upgrade\n<\/code><\/pre>\n\n\n\n<p>\u3053\u308c\u306b\u3088\u308a\u3001\u73fe\u5728\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u306e Airflow \u3068\u4e00\u81f4\u3059\u308b\u3088\u3046\u306b\u30e1\u30bf\u30d9\u30fc\u30b9\u304c\u81ea\u52d5\u7684\u306b\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u4e88\u9632\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30e1\u30bf\u30c7\u30fc\u30bf \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u63a5\u7d9a\u60c5\u5831\u3092\u69cb\u6210\u3059\u308b\u3068\u304d\u306f\u3001\u63a5\u7d9a\u60c5\u5831\u304c\u6b63\u3057\u304f\u3001\u5b89\u5168\u3067\u3001\u4fe1\u983c\u3067\u304d\u308b\u3082\u306e\u3067\u3042\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u307e\u305f\u306f\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u3059\u308b\u3068\u304d\u306f\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u304c\u6b63\u5e38\u3067\u3042\u308b\u3053\u3068\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u304c\u5b58\u5728\u3057\u306a\u3044\u304b\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3001\u304a\u3088\u3073\u5341\u5206\u306a\u6a29\u9650\u304c\u3042\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>SQLite \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001\u30d1\u30b9\u533a\u5207\u308a\u306e\u554f\u984c\u306b\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Windows \u3067\u306f\u3001\u30d1\u30b9\u306e\u533a\u5207\u308a\u8a18\u53f7\u306f\u30d0\u30c3\u30af\u30b9\u30e9\u30c3\u30b7\u30e5\u3067\u3059<code>\\<\/code>\u304c\u3001Linux \u304a\u3088\u3073 macOS \u3067\u306f\u3001\u30d1\u30b9\u306e\u533a\u5207\u308a\u8a18\u53f7\u306f\u30b9\u30e9\u30c3\u30b7\u30e5\u3067\u3059<code>\/<\/code>\u3002<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30e1\u30bf\u30c7\u30fc\u30bf \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u60c5\u5831\u3092\u69cb\u6210\u3059\u308b\u5834\u5408\u3001MySQL\u3001PostgreSQL \u306a\u3069\u306e\u4ed6\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u6587\u5b57\u5217\u3092\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u7279\u5b9a\u306e\u63a5\u7d9a\u6587\u5b57\u5217\u306e\u5f62\u5f0f\u306b\u3064\u3044\u3066\u306f\u3001\u5bfe\u5fdc\u3059\u308b\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/li>\n\n\n\n<li>\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u521d\u671f\u5316\u307e\u305f\u306f\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9\u6642\u306b\u30a8\u30e9\u30fc\u307e\u305f\u306f\u4f8b\u5916\u304c\u767a\u751f\u3057\u305f\u5834\u5408\u306f\u3001<code>airflow db reset<\/code>\u30b3\u30de\u30f3\u30c9\u3002\u305f\u3060\u3057\u3001\u3053\u308c\u306b\u3088\u308a\u3001DAG\u3001\u30bf\u30b9\u30af\u3001\u30ed\u30b0\u306a\u3069\u3092\u542b\u3080\u3059\u3079\u3066\u306e\u30e1\u30bf\u30c7\u30fc\u30bf\u60c5\u5831\u304c\u524a\u9664\u3055\u308c\u308b\u305f\u3081\u3001\u6ce8\u610f\u3057\u3066\u4f7f\u7528\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30e1\u30bf\u30c7\u30fc\u30bf \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u5fa9\u5143\u306b\u3082\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30e1\u30bf\u30c7\u30fc\u30bf \u30ea\u30dd\u30b8\u30c8\u30ea\u306e\u5b9a\u671f\u7684\u306a\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3001\u30b3\u30d4\u30fc\u3001\u307e\u305f\u306f\u540c\u671f\u3092\u4f7f\u7528\u3057\u3066\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u4fe1\u983c\u6027\u3092\u4fdd\u8b77\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u306e\u30af\u30ea\u30fc\u30cb\u30f3\u30b0\u3068\u7ba1\u7406\u306b\u3082\u6ce8\u610f\u3092\u6255\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u30e1\u30bf\u30c7\u30fc\u30bf\u306f\u5927\u304d\u306a\u30b9\u30c8\u30ec\u30fc\u30b8 \u30b9\u30da\u30fc\u30b9\u3092\u5360\u6709\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b\u305f\u3081\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u3092\u5b9a\u671f\u7684\u306b\u30af\u30ea\u30fc\u30cb\u30f3\u30b0\u3057\u3066\u30a2\u30fc\u30ab\u30a4\u30d6\u3057\u3001\u30b9\u30c8\u30ec\u30fc\u30b8 \u30b9\u30da\u30fc\u30b9\u306e\u6d6a\u8cbb\u3068\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306e\u4f4e\u4e0b\u3092\u9632\u3050\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u6700\u9069\u5316\u306b\u3082\u6ce8\u610f\u3092\u6255\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9 \u30d1\u30e9\u30e1\u30fc\u30bf\u3001\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u4f5c\u6210\u3001\u30ad\u30e3\u30c3\u30b7\u30e5\u306a\u3069\u306e\u8a2d\u5b9a\u3092\u8abf\u6574\u3057\u3066\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u5fdc\u7b54\u901f\u5ea6\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u540c\u6642\u306b\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u3088\u308a\u8a73\u7d30\u306a\u7ba1\u7406\u3068\u6700\u9069\u5316\u306e\u305f\u3081\u306b\u3001pgAdmin\u3001phpMyAdmin\u3001Navicat \u306a\u3069\u306e\u30b5\u30fc\u30c9\u30d1\u30fc\u30c6\u30a3 \u30c4\u30fc\u30eb\u3068\u30b5\u30fc\u30d3\u30b9\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u4e92\u63db\u6027\u306b\u3082\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u306f\u65b0\u3057\u3044\u30d0\u30fc\u30b8\u30e7\u30f3\u3084\u30d1\u30c3\u30c1\u3092\u983b\u7e41\u306b\u30ea\u30ea\u30fc\u30b9\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b\u305f\u3081\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u3068 Airflow \u30d0\u30fc\u30b8\u30e7\u30f3\u306e\u4e92\u63db\u6027\u306b\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u4e00\u822c\u306b\u3001Airflow \u306e\u65b0\u3057\u3044\u30d0\u30fc\u30b8\u30e7\u30f3\u3067\u306f\u65b0\u3057\u3044\u30c6\u30fc\u30d6\u30eb\u3068\u30d5\u30a3\u30fc\u30eb\u30c9\u304c\u5c0e\u5165\u3055\u308c\u308b\u53ef\u80fd\u6027\u304c\u3042\u308b\u305f\u3081\u3001\u65b0\u3057\u3044\u6a5f\u80fd\u3092\u6b63\u5e38\u306b\u4f7f\u7528\u3059\u308b\u306b\u306f<code>airflow db upgrade<\/code>\u3001\u30b3\u30de\u30f3\u30c9\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u6a29\u9650\u7ba1\u7406\u306b\u3082\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u304c\u63d0\u4f9b\u3059\u308b\u8a8d\u8a3c\u304a\u3088\u3073\u627f\u8a8d\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u30e6\u30fc\u30b6\u30fc\u3068\u30b0\u30eb\u30fc\u30d7\u306b\u3088\u308b\u30e1\u30bf\u30c7\u30fc\u30bf\u3078\u306e\u30a2\u30af\u30bb\u30b9\u3068\u5909\u66f4\u3092\u5236\u9650\u3057\u3001\u6697\u53f7\u5316\u3068\u8a8d\u8a3c\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u30e1\u30bf\u30c7\u30fc\u30bf\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u4fdd\u8b77\u3067\u304d\u307e\u3059\u3002\u540c\u6642\u306b\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30ea\u30b9\u30af\u3092\u56de\u907f\u3059\u308b\u305f\u3081\u306b\u3001\u30d1\u30b9\u30ef\u30fc\u30c9\u3084 API \u30ad\u30fc\u306a\u3069\u306e\u6a5f\u5bc6\u60c5\u5831\u3092\u30e1\u30bf\u30c7\u30fc\u30bf\u306b\u4fdd\u5b58\u3057\u306a\u3044\u3088\u3046\u306b\u3059\u308b\u5fc5\u8981\u3082\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u306f\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3068\u9ad8\u53ef\u7528\u6027\u306b\u3082\u6ce8\u610f\u3092\u6255\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u5206\u6563\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3001\u30af\u30e9\u30b9\u30bf \u30c6\u30af\u30ce\u30ed\u30b8\u3001\u30ad\u30e3\u30c3\u30b7\u30e5 \u30c6\u30af\u30ce\u30ed\u30b8\u306a\u3069\u3092\u4f7f\u7528\u3057\u3066\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3068\u9ad8\u53ef\u7528\u6027\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u540c\u6642\u306b\u3001\u30b3\u30f3\u30c6\u30ca\u5316\u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u3068\u30af\u30e9\u30a6\u30c9 \u30cd\u30a4\u30c6\u30a3\u30d6 \u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u3092\u4f7f\u7528\u3057\u3066\u3001\u4f38\u7e2e\u81ea\u5728\u3067\u4fe1\u983c\u6027\u306e\u9ad8\u3044 Airflow \u74b0\u5883\u3092\u69cb\u7bc9\u3057\u3001\u3055\u307e\u3056\u307e\u306a\u898f\u6a21\u3068\u30cb\u30fc\u30ba\u306e\u30bf\u30b9\u30af\u3068\u30b7\u30ca\u30ea\u30aa\u306b\u5bfe\u51e6\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u7d50\u8ad6\u3068\u3057\u3066\u3001Airflow \u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u69cb\u6210\u306f\u3001Airflow \u3092\u4f7f\u7528\u3059\u308b\u4e0a\u3067\u91cd\u8981\u306a\u30b9\u30c6\u30c3\u30d7\u306e 1 \u3064\u3067\u3042\u308a\u3001\u771f\u5263\u306b\u53d6\u308a\u7d44\u3080\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u30e1\u30bf\u30c7\u30fc\u30bf \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u69cb\u6210\u304a\u3088\u3073\u7ba1\u7406\u3059\u308b\u3068\u304d\u306f\u3001\u63a5\u7d9a\u60c5\u5831\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3001\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u56de\u5fa9\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u6700\u9069\u5316\u3001\u30d0\u30fc\u30b8\u30e7\u30f3\u306e\u4e92\u63db\u6027\u3001\u6a29\u5229\u7ba1\u7406\u3001\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3001\u9ad8\u53ef\u7528\u6027\u306a\u3069\u306e\u554f\u984c\u306b\u6ce8\u610f\u3057\u3066\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u306e\u6b63\u5e38\u306a\u52d5\u4f5c\u3068\u53ef\u7528\u6027\u3092\u78ba\u4fdd\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u5546\u54c1\u3067\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b\u305f\u3081\u306e Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u69cb\u6210\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u305f\u3089\u3001Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3057\u3066\u3001Airflow \u304c DAG\u3001\u30bf\u30b9\u30af\u3001\u30ed\u30b0\u306a\u3069\u306e\u30e1\u30bf\u30c7\u30fc\u30bf\u60c5\u5831\u3092\u4fdd\u5b58\u304a\u3088\u3073\u7ba1\u7406\u3067\u304d\u308b\u3088\u3046\u306b\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b\u624b\u9806\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9 \u30e9\u30a4\u30f3 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u958b\u304f \u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9 \u30e9\u30a4\u30f3 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u958b\u304d\u3001\u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9 \u30e9\u30a4\u30f3\u3067\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3067\u304d\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u3092\u5165\u529b\u3057\u307e\u3059 \u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9 \u30e9\u30a4\u30f3\u306b Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u3092\u5165\u529b\u3057\u307e\u3059\u3002\u6b21\u306b\u4f8b\u3092\u793a\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">bash\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>cd \/home\/user\/airflow\n<\/code><\/pre>\n\n\n\n<p>Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306f\u3069\u3053\u306b<code>\/home\/user\/airflow<\/code>\u3042\u308b\u306e\u3067\u3001\u5b9f\u969b\u306e\u72b6\u6cc1\u306b\u5fdc\u3058\u3066\u7f6e\u304d\u63db\u3048\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u521d\u671f\u5316 \u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9\u30e9\u30a4\u30f3\u3067\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066\u3001Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">csharp\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow db init\n<\/code><\/pre>\n\n\n\n<p>\u3053\u306e\u30b3\u30de\u30f3\u30c9\u306f\u3001DAG\u3001\u30bf\u30b9\u30af\u3001\u30ed\u30b0\u306a\u3069\u306e\u30e1\u30bf\u30c7\u30fc\u30bf\u60c5\u5831\u3092\u683c\u7d0d\u3059\u308b\u305f\u3081\u306b\u5fc5\u8981\u306a\u30c6\u30fc\u30d6\u30eb\u3068\u30a4\u30f3\u30c7\u30c3\u30af\u30b9\u3092\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u4f5c\u6210\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>Airflow \u30e6\u30fc\u30b6\u30fc\u306e\u4f5c\u6210 \u30bf\u30fc\u30df\u30ca\u30eb\u307e\u305f\u306f\u30b3\u30de\u30f3\u30c9 \u30e9\u30a4\u30f3\u3067\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066\u3001Airflow \u30e6\u30fc\u30b6\u30fc\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">css\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow users create \\\n    --username admin \\\n    --password admin \\\n    --firstname John \\\n    --lastname Doe \\\n    --role Admin \\\n    --email admin@example.com\n<\/code><\/pre>\n\n\n\n<p>\u3053\u306e\u30b3\u30de\u30f3\u30c9\u306f\u3001 username \u3001 password&nbsp;\u3001 name&nbsp;\u3001 role&nbsp;\u3001\u304a\u3088\u3073 email<code>admin<\/code>\u3068\u3044\u3046\u540d\u524d\u306e\u30e6\u30fc\u30b6\u30fc\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<code>admin<\/code><code>admin<\/code><code>John Doe<\/code><code>Admin<\/code><code>admin@example.com<\/code><\/p>\n\n\n\n<p>\u4e88\u9632\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b\u524d\u306b\u3001\u5fc5\u8981\u306a\u4f9d\u5b58\u95a2\u4fc2\u3068\u74b0\u5883\u304c\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u3001\u69cb\u6210\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u30e6\u30fc\u30b6\u30fc\u3092\u4f5c\u6210\u3059\u308b\u3068\u304d\u306f\u3001\u5f37\u529b\u306a\u30d1\u30b9\u30ef\u30fc\u30c9\u3068\u5b89\u5168\u306a\u30e6\u30fc\u30b6\u30fc\u540d\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30ea\u30b9\u30af\u3092\u56de\u907f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u30e6\u30fc\u30b6\u30fc\u3092\u4f5c\u6210\u3059\u308b\u3068\u304d\u306f\u3001\u5f79\u5272\u3068\u6a29\u9650\u3092\u614e\u91cd\u306b\u5272\u308a\u5f53\u3066\u3066\u3001\u6a29\u9650\u306e\u8aa4\u7528\u3084\u60aa\u7528\u3092\u907f\u3051\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3057\u305f\u5f8c\u3001\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u30c7\u30d5\u30a9\u30eb\u30c8\u306e\u30b5\u30f3\u30d7\u30eb DAG \u3092\u4f5c\u6210\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">css\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>airflow dags example --save example_dags\n<\/code><\/pre>\n\n\n\n<p>\u3053\u306e\u30b3\u30de\u30f3\u30c9\u306f\u3001\u3044\u304f\u3064\u304b\u306e\u7c21\u5358\u306a\u30b5\u30f3\u30d7\u30eb DAG \u3092\u4f5c\u6210\u3057\u3001<code>~\/airflow\/example_dags<\/code>\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306e\u3002\u3053\u308c\u3089\u306e\u30b5\u30f3\u30d7\u30eb DAG \u306f\u3001\u30c6\u30b9\u30c8\u3068\u5b66\u7fd2\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u69cb\u6210\u3057\u305f\u5f8c\u3001Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3057\u3066\u30e1\u30bf\u30c7\u30fc\u30bf \u30b9\u30c8\u30ec\u30fc\u30b8\u69cb\u9020\u3092\u78ba\u7acb\u3057\u3001DAG\u3001\u30bf\u30b9\u30af\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u306a\u3069\u306e\u5f8c\u7d9a\u306e\u64cd\u4f5c\u306e\u305f\u3081\u306b\u30c7\u30d5\u30a9\u30eb\u30c8\u306e\u7ba1\u7406\u8005\u30e6\u30fc\u30b6\u30fc\u3092\u4f5c\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u521d\u671f\u5316\u3059\u308b\u3068\u304d\u306f\u3001\u4f9d\u5b58\u95a2\u4fc2\u3068\u74b0\u5883\u3001\u30e6\u30fc\u30b6\u30fc\u540d\u3068\u30d1\u30b9\u30ef\u30fc\u30c9\u3001\u5f79\u5272\u3068\u6a29\u9650\u306a\u3069\u306e\u554f\u984c\u306b\u6ce8\u610f\u3057\u3066\u3001Airflow \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u6b63\u5e38\u306a\u52d5\u4f5c\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u78ba\u4fdd\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow DAG\uff08\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5\uff09\u306e\u57fa\u672c\u7684\u306a\u8003\u3048\u65b9\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>DAG \u306f Airflow \u306b\u304a\u3051\u308b\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5 (Directed Acyclic Graph) \u3092\u6307\u3057\u307e\u3059\u3002DAG \u306f\u3001\u4e00\u9023\u306e\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8a18\u8ff0\u3057\u3001\u305d\u308c\u3089\u306e\u5b9f\u884c\u9806\u5e8f\u3092\u6307\u5b9a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b\u30c7\u30fc\u30bf\u69cb\u9020\u3067\u3059\u3002Airflow \u3067\u306f\u3001\u5404 DAG \u306f\u6709\u5411\u30a8\u30c3\u30b8\u3068\u9802\u70b9\u306e\u30bb\u30c3\u30c8\u3067\u69cb\u6210\u3055\u308c\u3001\u5404\u9802\u70b9\u306f\u30bf\u30b9\u30af\u3092\u8868\u3057\u3001\u5404\u6709\u5411\u30a8\u30c3\u30b8\u306f\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8868\u3057\u307e\u3059\u3002DAG \u5185\u306e\u5404\u30bf\u30b9\u30af\u306f\u3001\u5b9f\u884c\u6642\u9593\u3001\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3001\u30bf\u30b9\u30af \u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u5c5e\u6027\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u4ee5\u4e0b\u306f\u3001DAG \u306e\u3044\u304f\u3064\u304b\u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3068\u7279\u5fb4\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5 DAG \u306f\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8868\u3059\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5\u3067\u3059\u3002DAG \u3067\u306f\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u306f\u6307\u793a\u3059\u308b\u3053\u3068\u3057\u304b\u3067\u304d\u307e\u305b\u3093\u3002\u3064\u307e\u308a\u30011 \u3064\u306e\u30bf\u30b9\u30af\u306f\u4ed6\u306e\u30bf\u30b9\u30af\u306b\u3057\u304b\u4f9d\u5b58\u3067\u304d\u305a\u3001\u5faa\u74b0\u7684\u306a\u4f9d\u5b58\u95a2\u4fc2\u306f\u767a\u751f\u3057\u307e\u305b\u3093\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af DAG \u306e\u5404\u9802\u70b9\u306f\u3001\u5b9f\u884c\u53ef\u80fd\u306a\u4efb\u610f\u306e Python \u95a2\u6570\u307e\u305f\u306f\u5916\u90e8\u30b3\u30de\u30f3\u30c9 (Bash \u30b3\u30de\u30f3\u30c9\u3001Python \u30b9\u30af\u30ea\u30d7\u30c8\u3001SQL \u30af\u30a8\u30ea\u306a\u3069) \u3067\u3042\u308b\u30bf\u30b9\u30af\u3092\u8868\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u4f9d\u5b58\u95a2\u4fc2 DAG \u306e\u5404\u6709\u5411\u30a8\u30c3\u30b8\u306f\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8868\u3057\u307e\u3059\u3002\u3064\u307e\u308a\u3001\u30bf\u30b9\u30af\u306f\u3001\u4ed6\u306e\u30bf\u30b9\u30af\u304c\u5b8c\u4e86\u3059\u308b\u307e\u3067\u5b9f\u884c\u3067\u304d\u307e\u305b\u3093\u3002Airflow \u3067\u306f\u3001\u6f14\u7b97\u5b50\u3092\u4f7f\u7528\u3057\u3066\u3001BashOperator\u3001PythonOperator\u3001SqlOperator \u306a\u3069\u306e\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8868\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30a4\u30e0 \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0 DAG \u5185\u306e\u5404\u30bf\u30b9\u30af\u306f\u3001\u305d\u306e\u5b9f\u884c\u6642\u9593\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb \u30eb\u30fc\u30eb (\u6bce\u65e5\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3055\u308c\u305f\u5b9f\u884c\u3001\u6bce\u9031\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3055\u308c\u305f\u5b9f\u884c\u306a\u3069) \u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3092\u4f7f\u7528\u3057\u3066 DAG \u5185\u306e\u30bf\u30b9\u30af\u3092\u81ea\u52d5\u7684\u306b\u5b9f\u884c\u3057\u3001\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0 \u30eb\u30fc\u30eb\u306b\u5f93\u3063\u3066\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u9593\u3068\u9806\u5e8f\u3092\u81ea\u52d5\u7684\u306b\u8a08\u7b97\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d1\u30e9\u30e1\u30fc\u30bf\u3068\u5909\u6570 DAG \u306e\u5404\u30bf\u30b9\u30af\u306f\u3001\u5b9f\u884c\u6642\u9593\u3001\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u3001\u518d\u8a66\u884c\u56de\u6570\u3001\u30bf\u30a4\u30e0\u30a2\u30a6\u30c8\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u30bf\u30a4\u30e0\u30a2\u30a6\u30c8\u671f\u9593\u306e\u8a2d\u5b9a\u306a\u3069\u3001\u30bf\u30b9\u30af\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3057\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u9593\u304c\u9577\u3059\u304e\u3066 DAG \u5168\u4f53\u306e\u5b9f\u884c\u52b9\u7387\u306b\u5f71\u97ff\u3092\u4e0e\u3048\u306a\u3044\u3088\u3046\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001DAG \u306f Airflow \u306e\u4e2d\u5fc3\u7684\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001\u30bf\u30b9\u30af\u306e\u30b0\u30eb\u30fc\u30d7\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8a18\u8ff0\u3057\u3001\u305d\u308c\u3089\u306e\u5b9f\u884c\u9806\u5e8f\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0 \u30eb\u30fc\u30eb\u3092\u6307\u5b9a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002DAG \u3067\u306f\u3001\u5404\u30bf\u30b9\u30af\u306f\u3001\u5b9f\u884c\u6642\u9593\u3001\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3001\u30bf\u30b9\u30af \u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u5c5e\u6027\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002DAG \u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u52b9\u679c\u7684\u306b\u7ba1\u7406\u3057\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow Task \u306e\u57fa\u672c\u7684\u306a\u8003\u3048\u65b9\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Task \u306f Airflow \u306b\u304a\u3051\u308b\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3001DAG \u306e\u30ce\u30fc\u30c9\u3092\u6307\u3057\u3001\u5b9f\u884c\u53ef\u80fd\u306a\u30bf\u30b9\u30af\u3092\u8868\u3057\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u5404\u30bf\u30b9\u30af\u306f\u3001Bash \u30b3\u30de\u30f3\u30c9\u3001Python \u30b9\u30af\u30ea\u30d7\u30c8\u3001SQL \u30af\u30a8\u30ea\u306a\u3069\u306e Python \u547c\u3073\u51fa\u3057\u53ef\u80fd\u30d7\u30ed\u30b0\u30e9\u30e0\u307e\u305f\u306f\u5916\u90e8\u5b9f\u884c\u53ef\u80fd\u30d7\u30ed\u30b0\u30e9\u30e0\u3067\u3059\u3002\u30bf\u30b9\u30af\u306f DAG \u306e\u57fa\u672c\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3042\u308a\u3001\u30bf\u30b9\u30af\u306e\u52d5\u4f5c\u3068\u30d7\u30ed\u30d1\u30c6\u30a3\u3092\u8a18\u8ff0\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002Task \u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3068\u7279\u5fb4\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5b9f\u884c\u53ef\u80fd\u30bf\u30b9\u30af \u30bf\u30b9\u30af\u306f\u5b9f\u884c\u53ef\u80fd\u30bf\u30b9\u30af\u3067\u3042\u308a\u3001\u4efb\u610f\u306e\u5b9f\u884c\u53ef\u80fd\u306a Python \u547c\u3073\u51fa\u3057\u53ef\u80fd\u30d7\u30ed\u30b0\u30e9\u30e0\u307e\u305f\u306f\u5916\u90e8\u5b9f\u884c\u53ef\u80fd\u30d7\u30ed\u30b0\u30e9\u30e0\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u5404\u30bf\u30b9\u30af\u306f\u305d\u306e\u5b9f\u884c\u5185\u5bb9\u3068\u95a2\u9023\u3059\u308b\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u304a\u3088\u3073\u5909\u6570\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>DAG \u306e\u30ce\u30fc\u30c9 \u30bf\u30b9\u30af\u306f\u3001DAG \u306e\u30ce\u30fc\u30c9\u3067\u3042\u308a\u3001DAG \u306e\u5b9f\u884c\u5358\u4f4d\u3092\u8868\u3057\u307e\u3059\u3002DAG \u3067\u306f\u3001\u5404\u30bf\u30b9\u30af\u306f\u4ed6\u306e\u30bf\u30b9\u30af\u306b\u4f9d\u5b58\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u3001\u4ed6\u306e\u30bf\u30b9\u30af\u304b\u3089\u4f9d\u5b58\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u6f14\u7b97\u5b50 \u30bf\u30b9\u30af\u306f\u6f14\u7b97\u5b50\u3092\u4f7f\u7528\u3057\u3066\u3001\u305d\u306e\u5b9f\u884c\u5185\u5bb9\u3068\u52d5\u4f5c\u3092\u8a18\u8ff0\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001BashOperator\u3001PythonOperator\u3001SqlOperator \u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u6f14\u7b97\u5b50\u304b\u3089\u9078\u629e\u3067\u304d\u3001\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u8981\u4ef6\u306b\u5fdc\u3058\u3066\u3055\u307e\u3056\u307e\u306a\u6f14\u7b97\u5b50\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9 \u30bf\u30b9\u30af\u306b\u306f\u3001\u6210\u529f\u3001\u5931\u6557\u3001\u5b9f\u884c\u4e2d\u3001\u5f85\u6a5f\u4e2d\u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u30b9\u30c6\u30fc\u30bf\u30b9\u304c\u3042\u308a\u307e\u3059\u3002Airflow UI \u307e\u305f\u306f API \u3092\u4ecb\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u306e\u5909\u66f4\u306b\u3088\u308a\u3001\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9 \u30b3\u30fc\u30eb\u30d0\u30c3\u30af\u3068 DAG \u30b9\u30c6\u30fc\u30bf\u30b9 \u30b3\u30fc\u30eb\u30d0\u30c3\u30af\u304c\u30c8\u30ea\u30ac\u30fc\u3055\u308c\u3001\u5bfe\u5fdc\u3059\u308b\u64cd\u4f5c\u304c\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc \u30bf\u30b9\u30af\u306f\u3001\u518d\u8a66\u884c\u56de\u6570\u3001\u30bf\u30a4\u30e0\u30a2\u30a6\u30c8\u3001\u30ad\u30e5\u30fc\u540d\u306a\u3069\u3001\u30bf\u30b9\u30af\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u308b\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092 Task \u306b\u6e21\u3059\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0 \u30bf\u30b9\u30af\u306e\u5b9f\u884c\u4e2d\u306b\u3001\u5bfe\u5fdc\u3059\u308b\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u60c5\u5831\u3092\u751f\u6210\u3067\u304d\u307e\u3059\u3002Airflow UI \u307e\u305f\u306f API \u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u60c5\u5831\u3092\u8868\u793a\u3057\u305f\u308a\u3001\u30bf\u30b9\u30af\u3092\u30c7\u30d0\u30c3\u30b0\u304a\u3088\u3073\u30c8\u30e9\u30d6\u30eb\u30b7\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u3057\u305f\u308a\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001Task \u306f Airflow \u306b\u304a\u3051\u308b\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001DAG \u3067\u5b9f\u884c\u53ef\u80fd\u306a\u30bf\u30b9\u30af\u3092\u8a18\u8ff0\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059. Operators \u3092\u4f7f\u7528\u3057\u3066\u305d\u306e\u5b9f\u884c\u5185\u5bb9\u3068\u52d5\u4f5c\u3092\u8a18\u8ff0\u3057\u3001\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3067\u304d\u3001\u5bfe\u5fdc\u3059\u308b\u30ed\u30b0\u3068\u76e3\u8996\u60c5\u5831\u3092\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u751f\u6210\u3055\u308c\u307e\u3059\u3002Task \u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001DAG \u5185\u306e\u30bf\u30b9\u30af\u3092\u52b9\u679c\u7684\u306b\u7ba1\u7406\u3067\u304d\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow Operator \u306e\u57fa\u672c\u7684\u306a\u8003\u3048\u65b9\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u306f Airflow \u306e\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001\u7279\u5b9a\u306e\u64cd\u4f5c\u307e\u305f\u306f\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b\u7279\u5225\u306a\u30bf\u30a4\u30d7\u306e\u30bf\u30b9\u30af\u3067\u3059\u3002Operator \u306f\u3001Python \u547c\u3073\u51fa\u3057\u53ef\u80fd\u3001\u307e\u305f\u306f Bash \u30b3\u30de\u30f3\u30c9\u3001Python \u30b9\u30af\u30ea\u30d7\u30c8\u3001SQL \u30af\u30a8\u30ea\u306a\u3069\u306e\u5916\u90e8\u5b9f\u884c\u53ef\u80fd\u30d5\u30a1\u30a4\u30eb\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001Operator \u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u5b9f\u884c\u9806\u5e8f\u3092\u8a18\u8ff0\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002Operator \u306e\u3044\u304f\u3064\u304b\u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3068\u7279\u5fb4\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5b9f\u884c\u53ef\u80fd\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u306f\u3001\u4efb\u610f\u306e\u5b9f\u884c\u53ef\u80fd Python \u547c\u3073\u51fa\u3057\u53ef\u80fd\u307e\u305f\u306f\u5916\u90e8\u5b9f\u884c\u53ef\u80fd\u53ef\u80fd\u6027\u304c\u3042\u308b\u5b9f\u884c\u53ef\u80fd\u3067\u3059\u3002Airflow \u3067\u306f\u3001\u5404 Operator \u306f\u305d\u306e\u5b9f\u884c\u5185\u5bb9\u3068\u95a2\u9023\u3059\u308b\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u304a\u3088\u3073\u5909\u6570\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af \u30ce\u30fc\u30c9 \u30aa\u30da\u30ec\u30fc\u30bf\u306f\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u5b9f\u884c\u9806\u5e8f\u3092\u8a18\u8ff0\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b\u7279\u5225\u306a\u30bf\u30a4\u30d7\u306e\u30bf\u30b9\u30af\u3067\u3059\u3002DAG \u3067\u306f\u3001\u5404 Operator \u306f\u4ed6\u306e Operator \u306b\u4f9d\u5b58\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u3001\u4ed6\u306e Operator \u306b\u3088\u3063\u3066\u4f9d\u5b58\u3055\u308c\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u5b9a\u7fa9\u6e08\u307f\u306e\u6f14\u7b97\u5b50 Airflow \u306b\u306f\u3001BashOperator\u3001PythonOperator\u3001SqlOperator \u306a\u3069\u3001\u591a\u6570\u306e\u5b9a\u7fa9\u6e08\u307f\u306e\u6f14\u7b97\u5b50\u304c\u3042\u308a\u307e\u3059\u3002\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u8981\u4ef6\u306b\u5fdc\u3058\u3066\u3001\u3055\u307e\u3056\u307e\u306a\u6f14\u7b97\u5b50\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30ab\u30b9\u30bf\u30e0 \u30aa\u30da\u30ec\u30fc\u30bf \u5b9a\u7fa9\u6e08\u307f\u306e\u30aa\u30da\u30ec\u30fc\u30bf\u3092\u4f7f\u7528\u3059\u308b\u3060\u3051\u3067\u306a\u304f\u3001\u30aa\u30da\u30ec\u30fc\u30bf\u3092\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3057\u3066\u7279\u5b9a\u306e\u30bf\u30b9\u30af\u8981\u4ef6\u3092\u6e80\u305f\u3059\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001BaseOperator \u30af\u30e9\u30b9\u3092\u7d99\u627f\u3057\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3057\u3001\u72ec\u81ea\u306e\u30d3\u30b8\u30cd\u30b9 \u30ed\u30b8\u30c3\u30af\u3092\u5b9f\u88c5\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d1\u30e9\u30e1\u30fc\u30bf\u3068\u5909\u6570 \u30aa\u30da\u30ec\u30fc\u30bf\u306f\u3001\u64cd\u4f5c\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u308b\u3001\u518d\u8a66\u884c\u56de\u6570\u3001\u30bf\u30a4\u30e0\u30a2\u30a6\u30c8\u3001\u30ad\u30e5\u30fc\u540d\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092 Operator \u306b\u6e21\u3059\u3053\u3068\u3067\u3001\u64cd\u4f5c\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0 Operator \u306e\u5b9f\u884c\u4e2d\u306b\u3001\u5bfe\u5fdc\u3059\u308b\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u60c5\u5831\u3092\u751f\u6210\u3067\u304d\u307e\u3059. Airflow UI \u307e\u305f\u306f API \u3092\u4f7f\u7528\u3057\u3066\u3001Operator \u306e\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u60c5\u5831\u3092\u8868\u793a\u3057\u305f\u308a\u3001\u30aa\u30da\u30ec\u30fc\u30b7\u30e7\u30f3\u306e\u30c7\u30d0\u30c3\u30b0\u3068\u30c8\u30e9\u30d6\u30eb\u30b7\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059.<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001\u30aa\u30da\u30ec\u30fc\u30bf\u306f Airflow \u306e\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3059. \u7279\u5b9a\u306e\u64cd\u4f5c\u307e\u305f\u306f\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059. \u5b9a\u7fa9\u6e08\u307f\u306e\u30aa\u30da\u30ec\u30fc\u30bf\u3092\u4f7f\u7528\u3059\u308b\u304b\u3001\u30aa\u30da\u30ec\u30fc\u30bf\u3092\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3057\u3066\u3001\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3057\u3001\u5bfe\u5fdc\u3059\u308b\u30ed\u30b0\u3068\u76e3\u8996\u60c5\u5831\u3092\u751f\u6210\u3067\u304d\u307e\u3059.&nbsp;Operator \u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001DAG \u5185\u306e\u30bf\u30b9\u30af\u3092\u52b9\u679c\u7684\u306b\u7ba1\u7406\u3057\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow TaskInstance \u306e\u57fa\u672c\u7684\u306a\u8003\u3048\u65b9\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>TaskInstance \u306f Airflow \u306b\u304a\u3051\u308b\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001DAG \u306b\u304a\u3051\u308b\u30bf\u30b9\u30af\u306e\u7279\u5b9a\u306e\u5b9f\u884c\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3067\u3059\u3002\u5404\u30bf\u30b9\u30af\u306f DAG \u306e\u8907\u6570\u306e\u5b9f\u884c\u30b5\u30a4\u30af\u30eb\u3067\u5b9f\u884c\u3055\u308c\u308b\u5834\u5408\u304c\u3042\u308a\u3001TaskInstance \u306f\u7279\u5b9a\u306e\u5b9f\u884c\u306b\u304a\u3051\u308b\u30bf\u30b9\u30af\u306e\u72b6\u614b\u3068\u7d50\u679c\u3092\u8868\u3057\u307e\u3059\u3002\u4ee5\u4e0b\u306f\u3001TaskInstance \u306e\u3044\u304f\u3064\u304b\u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3068\u7279\u5fb4\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>TaskInstance TaskInstance \u306f\u3001DAG \u306b\u304a\u3051\u308b\u30bf\u30b9\u30af\u306e\u7279\u5b9a\u306e\u5b9f\u884c\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3067\u3042\u308a\u3001\u7279\u5b9a\u306e\u5b9f\u884c\u30b5\u30a4\u30af\u30eb\u306b\u304a\u3051\u308b\u30bf\u30b9\u30af\u306e\u72b6\u614b\u3068\u7d50\u679c\u3092\u8868\u3057\u307e\u3059\u3002\u5404\u30bf\u30b9\u30af\u306f\u3001DAG \u5185\u306b\u8907\u6570\u306e TaskInstances \u3092\u6301\u3064\u3053\u3068\u304c\u3067\u304d\u3001\u7570\u306a\u308b\u5b9f\u884c\u30b5\u30a4\u30af\u30eb\u3067\u306e\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u8868\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9 TaskInstance \u306b\u306f\u3001\u6210\u529f\u3001\u5931\u6557\u3001\u5b9f\u884c\u4e2d\u3001\u5f85\u6a5f\u4e2d\u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u304c\u3042\u308a\u307e\u3059\u3002TaskInstance \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u306f\u3001Airflow UI \u307e\u305f\u306f API \u3092\u4ecb\u3057\u3066\u8868\u793a\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc TaskInstance \u306f\u3001\u518d\u8a66\u884c\u56de\u6570\u3001\u30bf\u30a4\u30e0\u30a2\u30a6\u30c8\u3001\u30ad\u30e5\u30fc\u540d\u306a\u3069\u3001\u30bf\u30b9\u30af\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u308b\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092 TaskInstance \u306b\u6e21\u3059\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306e\u52d5\u4f5c\u3068\u7d50\u679c\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0 TaskInstance \u306e\u5b9f\u884c\u4e2d\u306b\u3001\u5bfe\u5fdc\u3059\u308b\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u60c5\u5831\u3092\u751f\u6210\u3067\u304d\u307e\u3059. Airflow UI \u307e\u305f\u306f API \u3092\u4f7f\u7528\u3057\u3066\u3001TaskInstance \u306e\u30ed\u30b0\u3068\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u60c5\u5831\u3092\u8868\u793a\u3057\u3001\u30bf\u30b9\u30af\u306e\u30c7\u30d0\u30c3\u30b0\u3068\u30c8\u30e9\u30d6\u30eb\u30b7\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059.<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u306b\u4f9d\u5b58\u3059\u308b TaskInstance \u306f\u3001\u4ed6\u306e TaskInstance \u306b\u4f9d\u5b58\u3067\u304d\u307e\u3059\u3002\u3064\u307e\u308a\u3001\u73fe\u5728\u306e TaskInstance \u306f\u3001\u524d\u306e TaskInstance \u304c\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u305f\u5f8c\u306b\u306e\u307f\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u4f9d\u5b58\u95a2\u4fc2\u30eb\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066 TaskInstances \u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8a18\u8ff0\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001TaskInstance \u306f Airflow \u306e\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001DAG \u3067 Task \u306e\u7279\u5b9a\u306e\u5b9f\u884c\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3092\u8868\u3059\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u3001\u3044\u304f\u3064\u304b\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u5909\u6570\u3092\u8a2d\u5b9a\u3067\u304d\u3001\u5bfe\u5fdc\u3059\u308b\u30ed\u30b0\u3068\u76e3\u8996\u60c5\u5831\u3092\u751f\u6210\u3067\u304d\u3001\u4ed6\u306e TaskInstances \u306b\u4f9d\u5b58\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002TaskInstance \u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001DAG \u5185\u306e\u30bf\u30b9\u30af\u3092\u52b9\u679c\u7684\u306b\u7ba1\u7406\u3057\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow Executor \u306e\u57fa\u672c\u30b3\u30f3\u30bb\u30d7\u30c8\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Executor \u306f Airflow \u306e\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001TaskInstance \u306e\u5b9f\u884c\u3092\u62c5\u5f53\u3059\u308b\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3059\u3002Airflow \u306f\u3001LocalExecutor\u3001SequentialExecutor\u3001CeleryExecutor\u3001DaskExecutor \u306a\u3069\u306e\u8907\u6570\u306e Executor \u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u9069\u5207\u306a Executor \u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002Executor \u306e\u3044\u304f\u3064\u304b\u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3068\u7279\u5fb4\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>TaskInstance \u306e\u5b9f\u884c Executor \u306f\u3001TaskInstance \u306e\u5b9f\u884c\u3001\u3064\u307e\u308a\u3001\u6307\u5b9a\u3055\u308c\u305f\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0 \u30eb\u30fc\u30eb\u306b\u5f93\u3063\u3066 DAG \u5185\u306e Task \u306e\u5b9f\u884c\u3092\u62c5\u5f53\u3057\u307e\u3059\u3002Executor \u306f\u3001DAG \u306e\u4f9d\u5b58\u95a2\u4fc2\u306b\u5f93\u3063\u3066\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u9806\u5e8f\u3068\u5b9f\u884c\u6642\u9593\u3092\u81ea\u52d5\u7684\u306b\u8a08\u7b97\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u8907\u6570\u306e Executor Airflow \u306f\u3001LocalExecutor\u3001SequentialExecutor\u3001CeleryExecutor\u3001DaskExecutor \u306a\u3069\u306e\u8907\u6570\u306e Executor \u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u9069\u5207\u306a Executor \u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Concurrency Executor \u306f\u3001\u8907\u6570\u306e TaskInstances \u306e\u540c\u6642\u5b9f\u884c\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u540c\u6642\u5b9f\u884c\u6570\u3092\u69cb\u6210\u3059\u308b\u3053\u3068\u3067\u3001Executor \u306e\u540c\u6642\u5b9f\u884c\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>Resource Scheduling Executor \u306f\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0 \u30eb\u30fc\u30eb\u3068\u30bf\u30b9\u30af\u306e\u540c\u6642\u5b9f\u884c\u6027\u306b\u5f93\u3063\u3066\u3001CPU\u3001\u30e1\u30e2\u30ea\u3001\u30c7\u30a3\u30b9\u30af\u3001\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u306a\u3069\u306e\u30ea\u30bd\u30fc\u30b9\u3092\u5408\u7406\u7684\u306b\u5272\u308a\u5f53\u3066\u3066\u4f7f\u7528\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u30ea\u30bd\u30fc\u30b9\u5236\u9650\u3068\u30ad\u30e5\u30fc\u7ba1\u7406\u3092\u69cb\u6210\u3059\u308b\u3053\u3068\u3067\u3001Executor \u306e\u30ea\u30bd\u30fc\u30b9 \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b9\u30c6\u30fc\u30bf\u30b9\u7ba1\u7406 Executor \u306f\u3001TaskInstance \u306e\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u7dad\u6301\u3059\u308b\u8cac\u4efb\u304c\u3042\u308a\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u304c\u5b8c\u4e86\u3057\u305f\u5f8c\u3001\u5f8c\u7d9a\u306e\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u7ba1\u7406\u306e\u305f\u3081\u306b\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u30e1\u30bf\u30c7\u30fc\u30bf \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u66f8\u304d\u8fbc\u3080\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001Executor \u306f Airflow \u306b\u304a\u3051\u308b\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3042\u308a\u3001TaskInstance \u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u3001\u8907\u6570\u306e Executor \u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3001\u8907\u6570\u306e TaskInstances \u306e\u540c\u6642\u5b9f\u884c\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059.\u30ea\u30bd\u30fc\u30b9\u3092\u5408\u7406\u7684\u306b\u5272\u308a\u5f53\u3066\u3066\u4f7f\u7528\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u3001\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u7dad\u6301\u3059\u308b\u8cac\u4efb\u304c\u3042\u308a\u307e\u3059\u3002\u30bf\u30b9\u30af\u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3002Executor \u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001DAG \u5185\u306e\u30bf\u30b9\u30af\u3092\u52b9\u679c\u7684\u306b\u7ba1\u7406\u3067\u304d\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 \u521d\u3081\u3066\u306e Airflow DAG \u3092\u4f5c\u6210\u3059\u308b \u30b7\u30f3\u30d7\u30eb\u306a DAG \u3092\u4f5c\u6210\u3059\u308b<\/p>\n\n\n\n<p>\u901a\u5e38\u3001\u6700\u521d\u306e Airflow DAG \u306e\u4f5c\u6210\u306f\u3001\u5358\u7d14\u306a DAG \u306e\u4f5c\u6210\u304b\u3089\u59cb\u307e\u308a\u307e\u3059\u3002\u3053\u306e\u30bb\u30af\u30b7\u30e7\u30f3\u3067\u306f\u3001\u5358\u7d14\u306a DAG \u3092\u4f5c\u6210\u3057\u3066\u3001Airflow DAG \u306e\u57fa\u672c\u7684\u306a\u69cb\u9020\u3068\u69cb\u6587\u3092\u793a\u3059\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u307e\u305a\u3001Airflow \u306e DAG \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306b Python \u30b9\u30af\u30ea\u30d7\u30c8\u3092\u4f5c\u6210\u3057\u3001\u540d\u524d\u3092\u4ed8\u3051\u3066<code>my_first_dag.py<\/code>\u304b\u3089\u3001\u5fc5\u8981\u306a\u30e2\u30b8\u30e5\u30fc\u30eb\u3068\u30e9\u30a4\u30d6\u30e9\u30ea\u3092\u30b9\u30af\u30ea\u30d7\u30c8\u306b\u30a4\u30f3\u30dd\u30fc\u30c8\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime, timedelta\n<\/code><\/pre>\n\n\n\n<p>\u6b21\u306b\u3001DAG \u306e\u540d\u524d\u3001\u958b\u59cb\u6642\u9593\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u9593\u9694\u306a\u3069\u3001DAG \u306e\u3044\u304f\u3064\u304b\u306e\u57fa\u672c\u7684\u306a\u30d7\u30ed\u30d1\u30c6\u30a3\u3092\u5b9a\u7fa9\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>default_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_first_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001DAG \u306e\u540d\u524d\u306f<code>my_first_dag<\/code>\u3001\u958b\u59cb\u6642\u523b\u306f<code>datetime(2023, 1, 1)<\/code>\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u9593\u9694\u306f 1 \u65e5 1 \u56de\u306a\u3069\u3001DAG \u306e\u3044\u304f\u3064\u304b\u306e\u57fa\u672c\u7684\u306a\u30d7\u30ed\u30d1\u30c6\u30a3\u3092\u5b9a\u7fa9\u3057\u307e\u3059\u3002\u540c\u6642\u306b\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u56de\u6570\u3001\u518d\u8a66\u884c\u9593\u9694\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30c7\u30d5\u30a9\u30eb\u30c8 \u30d1\u30e9\u30e1\u30fc\u30bf\u3082\u5b9a\u7fa9\u3057\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u65e2\u5b9a\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u3001DAG \u5185\u306e\u3059\u3079\u3066\u306e\u30bf\u30b9\u30af\u306b\u9069\u7528\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u6b21\u306b\u3001DAG \u3067\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001BashOperator \u3092\u4f7f\u7528\u3057\u3066\u5358\u7d14\u306a\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task1 = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world!\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001 BashOperator \u3092\u4f7f\u7528\u3057\u3066\u5358\u7d14\u306a\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3059\u308b<code>print_hello<\/code>\u3068\u3044\u3046\u540d\u524d\u306e<code>echo \"Hello, world!\"<\/code>\u3002\u307e\u305f\u3001\u30bf\u30b9\u30af\u3092 DAG \u306b\u8ffd\u52a0\u3057\u3066\u3001\u5b9f\u884c\u3092\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u6700\u5f8c\u306b\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u306e\u4f8b\u3067\u306f\u3001Task \u304c 1 \u3064\u3057\u304b\u306a\u3044\u305f\u3081\u3001\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u5fc5\u8981\u306f\u3042\u308a\u307e\u305b\u3093\u3002\u305f\u3060\u3057\u3001\u5b9f\u969b\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3067\u306f\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u304c\u975e\u5e38\u306b\u91cd\u8981\u3067\u3042\u308a\u3001\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u5b9a\u7fa9\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task1\n<\/code><\/pre>\n\n\n\n<p>\u5b8c\u5168\u306a\u30b3\u30fc\u30c9\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_first_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ntask1 = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world\n<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u6700\u5f8c\u306b\u3001\u4e0a\u8a18\u306e\u30b3\u30fc\u30c9\u3092\u540d\u524d\u3092\u4ed8\u3051\u3066\u4fdd\u5b58\u3057<code>my_first_dag.py<\/code>\u3001Airflow \u306e DAG \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306b\u914d\u7f6e\u3057\u307e\u3059\u3002Airflow \u304c\u958b\u59cb\u3055\u308c\u308b\u3068\u3001\u3053\u306e DAG \u304c\u81ea\u52d5\u7684\u306b\u691c\u51fa\u3055\u308c\u3001\u5b9f\u884c\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u304c\u958b\u59cb\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306e UI \u3067\u3001DAG \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002\u3059\u3079\u3066\u304c\u9806\u8abf\u3067\u3042\u308c\u3070\u3001<code>print_hello<\/code>\u30bf\u30b9\u30af\u304c<code>echo \"Hello, world!\"<\/code>\u30b3\u30de\u30f3\u30c9\u3092\u6b63\u5e38\u306b\u5b9f\u884c\u3059\u308b\u306f\u305a\u3067\u3059\u3002<\/p>\n\n\n\n<p>\u3053\u308c\u306f\u3001DAG \u3092\u4f5c\u6210\u3057\u3066\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u7c21\u5358\u306a\u4f8b\u3067\u3059\u3002\u5b9f\u969b\u3001Airflow \u306e DAG \u306f\u3001\u3088\u308a\u8907\u96d1\u306a\u4f9d\u5b58\u95a2\u4fc2\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306e\u53d7\u3051\u6e21\u3057\u3001\u5909\u6570\u306e\u4f7f\u7528\u3001\u30bf\u30b9\u30af\u9593\u306e\u30c7\u30fc\u30bf\u8ee2\u9001\u306a\u3069\u3001\u4ed6\u306e\u591a\u304f\u306e\u6a5f\u80fd\u3082\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u7d99\u7d9a\u7684\u306a\u5b66\u7fd2\u3068\u5b9f\u8df5\u3092\u901a\u3058\u3066\u3001\u3088\u308a\u591a\u304f\u306e Airflow \u30b9\u30ad\u30eb\u3092\u7fd2\u5f97\u3057\u3001\u305d\u308c\u3092\u4f7f\u7528\u3057\u3066\u3088\u308a\u8907\u96d1\u306a\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u7ba1\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30bf\u30b9\u30af\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u6700\u521d\u306e Airflow DAG \u306e\u8a18\u8ff0\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u901a\u5e38\u3001DAG \u306f\u8907\u6570\u306e\u30bf\u30b9\u30af\u3067\u69cb\u6210\u3055\u308c\u3001\u5404\u30bf\u30b9\u30af\u306f\u7279\u5b9a\u306e\u64cd\u4f5c\u307e\u305f\u306f\u30bf\u30b9\u30af\u3092\u8868\u3057\u307e\u3059\u3002\u3053\u306e\u30bb\u30af\u30b7\u30e7\u30f3\u3067\u306f\u3001\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3057\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u5404\u30bf\u30b9\u30af\u306f Operator \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3067\u3042\u308a\u3001\u4e8b\u524d\u5b9a\u7fa9\u3055\u308c\u305f Operator \u307e\u305f\u306f\u30ab\u30b9\u30bf\u30e0 Operator \u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u306f\u901a\u5e38\u3001Bash \u30b3\u30de\u30f3\u30c9\u306e\u5b9f\u884c\u3001Python \u30b9\u30af\u30ea\u30d7\u30c8\u306e\u5b9f\u884c\u3001SQL \u30af\u30a8\u30ea\u306e\u5b9f\u884c\u306a\u3069\u3001\u7279\u5b9a\u306e\u64cd\u4f5c\u307e\u305f\u306f\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002BashOperator \u3092\u4f7f\u7528\u3057\u3066 Task \u3092\u5b9a\u7fa9\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u7c21\u5358\u306a\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_first_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ntask1 = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world!\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001BashOperator \u3092\u4f7f\u7528\u3057\u3066<code>print_hello<\/code>\u540d\u524d\u4ed8\u304d\u306e\u3001<code>echo \"Hello, world!\"<\/code>\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u300cHello, world!\u300d\u3092\u51fa\u529b\u3057\u307e\u3059\u3002\u307e\u305f\u3001\u30bf\u30b9\u30af\u3092 DAG \u306b\u8ffd\u52a0\u3057\u3066\u3001\u5b9f\u884c\u3092\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e\u5b9a\u7fa9\u306b\u52a0\u3048\u3066\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3082\u5b9a\u7fa9\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u4f9d\u5b58\u95a2\u4fc2\u30eb\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Task1 \u304c Task2 \u306b\u4f9d\u5b58\u3057\u3066\u3044\u308b\u5834\u5408\u3001\u6b21\u3092\u4f7f\u7528\u3057\u3066\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task2 &gt;&gt; task1\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001<code>&gt;&gt;<\/code>Task1 \u304c Task2 \u306b\u4f9d\u5b58\u3057\u3066\u3044\u308b\u3053\u3068\u3001\u3064\u307e\u308a\u3001Task2 \u304c Task1 \u306e\u524d\u306b\u5b9f\u884c\u3055\u308c\u306a\u3051\u308c\u3070\u306a\u3089\u306a\u3044\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002\u4ee5\u4e0b\u306f\u3001\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3057\u3001\u305d\u308c\u3089\u306e\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u5b8c\u5168\u306a\u4f8b\u3067\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_first_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ntask1 = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world!\"',\n    dag=dag,\n)\n\ntask2 = BashOperator(\n    task_id='print_date',\n    bash_command='date',\n    dag=dag,\n)\n\ntask2 &gt;&gt; task1\n<\/code><\/pre>\n\n\n\n<p>\u305d\u308c\u306f\u3053\u3053\u306b\u3042\u308b\u3001<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u300cHello, world!\u300d\u3068\u73fe\u5728\u306e\u65e5\u4ed8\u3092\u305d\u308c\u305e\u308c\u51fa\u529b\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b \u3068 \u306e<code>print_hello<\/code>2\u3064\u306e\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3057\u307e\u3059\u3002<code>print_date<\/code>\u307e\u305f\u3001<code>task2 &gt;&gt; task1<\/code>\u4f9d\u5b58\u95a2\u4fc2\u30eb\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001Task1 \u3092 Task2 \u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u3057\u3066\u5b9a\u7fa9\u3057\u307e\u3059\u3002\u3064\u307e\u308a\u3001DAG \u3067\u306f\u3001Task2 \u306f Task1 \u306e\u524d\u306b\u5b9f\u884c\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<p>Task1 \u3068 Task2 \u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3059\u308b\u5834\u5408\u306f\u3001<code>set_upstream<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task2.set_upstream(task1)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001<code>set_upstream<\/code>Task2 \u304c Task1 \u306b\u4f9d\u5b58\u3057\u3066\u3044\u308b\u3053\u3068\u3001\u3064\u307e\u308a\u3001Task1 \u304c Task2 \u306e\u524d\u306b\u5b9f\u884c\u3055\u308c\u306a\u3051\u308c\u3070\u306a\u3089\u306a\u3044\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002\u3053\u306e\u65b9\u6cd5\u306f\u4e0a\u8a18\u306e\u65b9\u6cd5\u3068\u540c\u7b49\u3067\u3059\u304c\u3001\u65b9\u5411\u304c\u9006\u3067\u3042\u308b\u3053\u3068\u306b\u6ce8\u610f\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n<p>\u5358\u4e00\u306e\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u306b\u52a0\u3048\u3066\u3001\u8907\u6570\u306e\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Task1\u3001Task2\u3001Task3 \u306e 3 \u3064\u306e Task \u304c\u3042\u308a\u3001Task3 \u306f Task1 \u3068 Task2 \u306e\u5b9f\u884c\u7d50\u679c\u306b\u4f9d\u5b58\u3059\u308b\u3068\u3057\u307e\u3059\u3002<code>set_upstream<\/code>\u3053\u306e\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001Task3 \u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task1.set_downstream(task3)\ntask2.set_downstream(task3)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001<code>set_downstream<\/code>Task3 \u304c Task1 \u3068 Task2 \u306b\u4f9d\u5b58\u3057\u3066\u3044\u308b\u3053\u3068\u3001\u3064\u307e\u308a\u3001Task1 \u3068 Task2 \u304c Task3 \u306e\u524d\u306b\u5b9f\u884c\u3055\u308c\u306a\u3051\u308c\u3070\u306a\u3089\u306a\u3044\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002\u3053\u308c\u306f\u3001Task3 \u304c Task1 \u3068 Task2 \u306e\u5b8c\u4e86\u3092\u5f85\u3063\u3066\u304b\u3089\u5b9f\u884c\u3092\u958b\u59cb\u3059\u308b\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Task \u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u3053\u3068\u304c Airflow DAG \u306e\u57fa\u672c\u3067\u3059\u3002\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3057\u3001\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u5b9a\u7fa9\u3059\u308b\u3053\u3068\u3067\u3001\u8907\u96d1\u306a\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u69cb\u7bc9\u3057\u3066\u3001\u3088\u308a\u8c4a\u5bcc\u3067\u52b9\u7387\u7684\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u3068\u5206\u6790\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u521d\u3081\u3066\u306e Airflow DAG \u306e\u4f5c\u6210\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3067 DAG \u3092\u8868\u793a<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u4f7f\u7528\u3057\u3066 DAG \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002\u3053\u306e\u30bb\u30af\u30b7\u30e7\u30f3\u3067\u306f\u3001Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3067 DAG \u3092\u8868\u793a\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u307e\u305a\u3001Airflow \u30b5\u30fc\u30d3\u30b9\u304c\u958b\u59cb\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3001\u304a\u3088\u3073\u8868\u793a\u3059\u308b DAG \u304c DAG \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306b\u8ffd\u52a0\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059 (DAG \u306e\u30d5\u30a1\u30a4\u30eb\u540d\u304c \u3067\u3042\u308b\u3068\u4eee\u5b9a\u3057\u307e\u3059)&nbsp;<code>my_first_dag.py<\/code>\u3002\u3059\u3079\u3066\u554f\u984c\u306a\u3051\u308c\u3070\u3001\u3053\u306e DAG \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092 Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3067\u8868\u793a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3067\u306f\u3001\u5de6\u5074\u306e\u30ca\u30d3\u30b2\u30fc\u30b7\u30e7\u30f3 \u30d0\u30fc\u306b<code>DAGs<\/code>\u30e1\u30cb\u30e5\u30fc\u3001\u30af\u30ea\u30c3\u30af\u3057\u3066 DAG \u30ea\u30b9\u30c8 \u30da\u30fc\u30b8\u306b\u5165\u308a\u307e\u3059\u3002\u3053\u306e\u30da\u30fc\u30b8\u3067\u306f\u3001<code>my_first_dag<\/code>\u3068\u3044\u3046\u540d\u524d\u306e\u3002\u30af\u30ea\u30c3\u30af\u3059\u308b\u3068\u3001DAG \u306e\u8a73\u7d30\u30da\u30fc\u30b8\u306b\u79fb\u52d5\u3057\u307e\u3059\u3002\u3053\u306e\u30da\u30fc\u30b8\u3067\u306f\u3001DAG \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3001\u5b9f\u884c\u5c65\u6b74\u3001\u30bf\u30b9\u30af \u30ea\u30b9\u30c8\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u60c5\u5831\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u305d\u306e\u4e2d\u3067\u3001<code>Graph View<\/code>\u30bf\u30d6 \u30da\u30fc\u30b8\u306f\u3001DAG \u306e\u69cb\u9020\u3068\u4f9d\u5b58\u95a2\u4fc2\u3092\u8868\u793a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002\u3053\u306e\u30bf\u30d6\u3067\u306f\u3001DAG \u5185\u306e\u3059\u3079\u3066\u306e\u30bf\u30b9\u30af\u3092\u8868\u793a\u3057\u3001\u305d\u308c\u3089\u306e\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u7406\u89e3\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u524d\u306e\u4f8b\u3067\u306f\u3001<code>print_hello<\/code>\u3068 \u306e2 \u3064\u306e\u30bf\u30b9\u30af\u3092\u5b9a\u7fa9\u3057<code>print_date<\/code>\u3001\u305d\u308c\u3089\u306e\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092 \u3068\u3057\u3066\u5b9a\u7fa9\u3057\u307e\u3057\u305f<code>task2 &gt;&gt; task1<\/code>\u3002<code>Graph View<\/code>\u3067\u306f\u3001\u6b21\u306e DAG \u30b0\u30e9\u30d5\u3092\u78ba\u8a8d\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">\u9306\u30b3\u30d4\u30fc\u30b3\u30fc\u30c9<code>print_date -&gt; print_hello\n<\/code><\/pre>\n\n\n\n<p>\u56f3\u3067\u306f\u3001\u77e2\u5370\u304c\u6307\u3059\u65b9\u5411\u304c\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001 \u304b\u3089\u306e\u77e2\u5370<code>print_date<\/code>\u306f\u306b\u4f9d\u5b58\u3059\u308b<code>print_hello<\/code>\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002\u3064\u307e\u308a\u3001\u306e\u524d\u306b\u5b9f\u884c\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<code>print_hello<\/code><code>print_date<\/code><code>print_date<\/code><code>print_hello<\/code><\/p>\n\n\n\n<p>\u3055\u3089\u306b\u3001\u306a\u3069<code>Graph View<\/code>\u3001DAG \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u8868\u793a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u308b\u30bf\u30d6\u304c\u4ed6\u306b\u3082\u3044\u304f\u3064\u304b\u3042\u308a\u307e\u3059<code>Tree View<\/code>\u3002<code>Gantt Chart<\/code>\u5404\u30bf\u30d6 \u30da\u30fc\u30b8\u306b\u306f\u3055\u307e\u3056\u307e\u306a\u30d3\u30e5\u30fc\u3068\u6a5f\u80fd\u304c\u7528\u610f\u3055\u308c\u3066\u304a\u308a\u3001\u5b9f\u969b\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3067 DAG \u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d50\u679c\u3092\u8868\u793a\u3059\u308b\u306e\u306f\u975e\u5e38\u306b\u4fbf\u5229\u3067\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001DAG \u306e\u5b9f\u884c\u3092\u5e38\u306b\u628a\u63e1\u3057\u3001\u5fc5\u8981\u306a\u8abf\u6574\u3068\u6700\u9069\u5316\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d44\u307f\u8fbc\u307f\u306e Operator BashOperator \u3092\u4f7f\u7528\u3057\u3066\u8a73\u7d30\u306b\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001BashOperator \u306f Bash \u30b3\u30de\u30f3\u30c9\u307e\u305f\u306f\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306e\u7d44\u307f\u8fbc\u307f Operator \u3067\u3059\u3002\u901a\u5e38\u3001\u30bf\u30fc\u30df\u30ca\u30eb\u3067\u5b9f\u884c\u3055\u308c\u308b\u30b3\u30de\u30f3\u30c9\u3084 Python \u30b9\u30af\u30ea\u30d7\u30c8\u306e\u5b9f\u884c\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u5358\u7d14\u306a\u30b3\u30de\u30f3\u30c9\u307e\u305f\u306f\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>BashOperator \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u5165\u308c\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>task_id<\/code>: \u4e00\u610f\u3067\u3042\u308b\u5fc5\u8981\u304c\u3042\u308b\u30bf\u30b9\u30af\u306e ID\u3002<\/li>\n\n\n\n<li><code>bash_command<\/code>: \u5b9f\u884c\u3059\u308b Bash \u30b3\u30de\u30f3\u30c9\u307e\u305f\u306f\u30b9\u30af\u30ea\u30d7\u30c8\u3002\u6587\u5b57\u5217\u307e\u305f\u306f\u6587\u5b57\u5217\u306e\u30ea\u30b9\u30c8\u3092\u6307\u5b9a\u3067\u304d\u307e\u3059\u3002\u6587\u5b57\u5217\u306e\u30ea\u30b9\u30c8\u306e\u5834\u5408\u3001\u30ea\u30b9\u30c8\u5185\u306e\u5404\u6587\u5b57\u5217\u306f\u500b\u5225\u306e\u30b3\u30de\u30f3\u30c9\u3068\u3057\u3066\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>xcom_push<\/code>: \u30b3\u30de\u30f3\u30c9\u51fa\u529b\u3092 XCom \u3068\u3057\u3066\u5f8c\u7d9a\u306e\u30bf\u30b9\u30af\u306b\u6e21\u3059\u304b\u3069\u3046\u304b\u3002\u30c7\u30d5\u30a9\u30eb\u30c8\u306f False \u3067\u3059\u3002<\/li>\n\n\n\n<li><code>env<\/code>: \u8a2d\u5b9a\u3059\u308b\u74b0\u5883\u5909\u6570\u3002\u30c7\u30a3\u30af\u30b7\u30e7\u30ca\u30ea\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>output_encoding<\/code>: \u30b3\u30de\u30f3\u30c9\u51fa\u529b\u306e\u30a8\u30f3\u30b3\u30fc\u30c9\u5f62\u5f0f\u3002\u30c7\u30d5\u30a9\u30eb\u30c8\u306f utf-8 \u3067\u3059\u3002<\/li>\n\n\n\n<li><code>bash_exit_code<\/code>: \u8a31\u53ef\u3055\u308c\u305f\u7d42\u4e86\u30b3\u30fc\u30c9\u306e\u30ea\u30b9\u30c8\u3001\u30c7\u30d5\u30a9\u30eb\u30c8 [0]\u3002<\/li>\n\n\n\n<li><code>dag<\/code>: \u6240\u5c5e\u7684 DAG\u3002<\/li>\n<\/ul>\n\n\n\n<p>BashOperator \u3092\u4f7f\u7528\u3057\u3066\u5358\u7d14\u306a Bash \u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ntask = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world!\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001BashOperator \u3092\u4f7f\u7528\u3057\u3066<code>print_hello<\/code>\u540d\u524d\u4ed8\u304d\u306e\u3001<code>echo \"Hello, world!\"<\/code>\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u300cHello, world!\u300d\u3092\u51fa\u529b\u3057\u307e\u3059\u3002\u307e\u305f\u3001\u30bf\u30b9\u30af\u3092 DAG \u306b\u8ffd\u52a0\u3057\u3066\u3001\u5b9f\u884c\u3092\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3067\u304d\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u5b9f\u884c\u3055\u308c\u308b\u3068\u3001BashOperator \u306f\u30b7\u30b9\u30c6\u30e0 \u30bf\u30fc\u30df\u30ca\u30eb\u3067<code>echo \"Hello, world!\"<\/code>\u30b3\u30de\u30f3\u30c9\u3092\u3001\u30bf\u30b9\u30af\u306e\u7d50\u679c\u3068\u3057\u3066\u30b3\u30de\u30f3\u30c9\u306e\u51fa\u529b\u3092\u8fd4\u3057\u307e\u3059\u3002\u30b3\u30de\u30f3\u30c9\u51fa\u529b\u3092\u5f8c\u7d9a\u306e\u30bf\u30b9\u30af\u306b\u6e21\u3059\u5fc5\u8981\u304c\u3042\u308b\u5834\u5408\u306f\u3001<code>xcom_push<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002\u6b21\u306b\u4f8b\u3092\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world!\"',\n    xcom_push=True,\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f set \u3067\u3059\u3002<code>xcom_push=True<\/code>\u3053\u308c\u306f\u3001\u30b3\u30de\u30f3\u30c9\u306e\u51fa\u529b\u304c XCom \u3068\u3057\u3066\u5f8c\u7d9a\u306e\u30bf\u30b9\u30af\u306b\u6e21\u3055\u308c\u308b\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002\u5f8c\u7d9a\u306e\u30bf\u30b9\u30af\u306f\u3001\u3053\u306e\u51fa\u529b\u3092\u53d6\u5f97\u3059\u308b<code>{{ ti.xcom_pull(task_ids='print_hello') }}<\/code>\u305f\u3081\u306b\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001BashOperator \u306f Airflow \u306e\u975e\u5e38\u306b\u4fbf\u5229\u306a\u7d44\u307f\u8fbc\u307f Operator \u3067\u3042\u308a\u3001\u3055\u307e\u3056\u307e\u306a Bash \u30b3\u30de\u30f3\u30c9\u3068\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u5b9f\u884c\u3057\u3001\u30b3\u30de\u30f3\u30c9\u51fa\u529b\u3092\u5f8c\u7d9a\u306e\u30bf\u30b9\u30af\u306b\u6e21\u3059\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002BashOperator \u306e\u8ce2\u660e\u306a\u4f7f\u7528\u306b\u3088\u308a\u3001<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u8907\u96d1\u306a\u30c7\u30fc\u30bf\u51e6\u7406\u30fb\u89e3\u6790\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u7c21\u5358\u306b\u69cb\u7bc9\u3057\u3001\u4f5c\u696d\u52b9\u7387\u3068\u30c7\u30fc\u30bf\u51e6\u7406\u54c1\u8cea\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d44\u307f\u8fbc\u307f\u306e\u6f14\u7b97\u5b50 PythonOperator \u3092\u4f7f\u7528\u3057\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001PythonOperator \u306f Python \u95a2\u6570\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306e\u7d44\u307f\u8fbc\u307f Operator \u3067\u3059\u3002BashOperator \u3068\u306f\u7570\u306a\u308a\u3001PythonOperator \u306f Python \u95a2\u6570\u3092\u30bf\u30fc\u30df\u30ca\u30eb\u7d4c\u7531\u3067\u5b9f\u884c\u305b\u305a\u306b\u76f4\u63a5\u547c\u3073\u51fa\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>PythonOperator \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>task_id<\/code>: \u4e00\u610f\u3067\u3042\u308b\u5fc5\u8981\u304c\u3042\u308b\u30bf\u30b9\u30af\u306e ID\u3002<\/li>\n\n\n\n<li><code>python_callable<\/code>: \u5b9f\u884c\u3059\u308b Python \u95a2\u6570\u3002\u95a2\u6570\u3001\u30e1\u30bd\u30c3\u30c9\u3001callable\u3001\u307e\u305f\u306f\u30d1\u30b9\u6587\u5b57\u5217\u3092\u6307\u5b9a\u3067\u304d\u307e\u3059\u3002\u30d1\u30b9\u6587\u5b57\u5217\u306e\u5834\u5408\u3001\u95a2\u6570\u306f\u305d\u306e\u30d1\u30b9\u306b\u5f93\u3063\u3066\u30a4\u30f3\u30dd\u30fc\u30c8\u304a\u3088\u3073\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>op_args<\/code>: \u30ea\u30b9\u30c8\u3068\u3057\u3066\u63d0\u4f9b\u3055\u308c\u308b Python \u95a2\u6570\u3078\u306e\u4f4d\u7f6e\u5f15\u6570\u3002<\/li>\n\n\n\n<li><code>op_kwargs<\/code>: \u8f9e\u66f8\u3068\u3057\u3066\u63d0\u4f9b\u3055\u308c\u308b\u3001Python \u95a2\u6570\u3078\u306e\u30ad\u30fc\u30ef\u30fc\u30c9\u5f15\u6570\u3002<\/li>\n\n\n\n<li><code>provide_context<\/code>: \u30bf\u30b9\u30af \u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u8ffd\u52a0\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u3057\u3066 Python \u95a2\u6570\u306b\u6e21\u3059\u304b\u3069\u3046\u304b\u3002\u65e2\u5b9a\u5024\u306f False \u3067\u3059\u3002<\/li>\n\n\n\n<li><code>templates_dict<\/code>: Python \u95a2\u6570\u3067\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u6587\u5b57\u5217\u3092\u30ec\u30f3\u30c0\u30ea\u30f3\u30b0\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u308b\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306e\u30c7\u30a3\u30af\u30b7\u30e7\u30ca\u30ea\u3002<\/li>\n\n\n\n<li><code>templates_exts<\/code>: \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306e\u30ec\u30f3\u30c0\u30ea\u30f3\u30b0\u306b\u4f7f\u7528\u3055\u308c\u308b\u30d5\u30a1\u30a4\u30eb\u62e1\u5f35\u5b50\u3002<\/li>\n\n\n\n<li><code>dag<\/code>: \u6240\u5c5e\u7684 DAG\u3002<\/li>\n<\/ul>\n\n\n\n<p>PythonOperator \u3092\u4f7f\u7528\u3057\u3066\u5358\u7d14\u306a Python \u95a2\u6570\u3092\u5b9f\u884c\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.python_operator import PythonOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ndef print_hello():\n    print('Hello, world!')\n\ntask = PythonOperator(\n    task_id='print_hello',\n    python_callable=print_hello,\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001\u300cHello, world!\u300d<code>print_hello<\/code>\u3092\u3002\u6b21\u306b\u3001PythonOperator \u3092\u4f7f\u7528\u3057\u3066 Task \u3092\u5b9a\u7fa9\u3057\u3001Python \u95a2\u6570\u3092 PythonOperator \u306b<code>python_callable<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002\u5b9f\u884c\u6642\u306b\u3001PythonOperator \u306f Python \u95a2\u6570\u3092\u76f4\u63a5\u547c\u3073\u51fa\u3057\u3001\u95a2\u6570\u672c\u4f53\u306e\u30b3\u30fc\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>BashOperator \u3068\u540c\u69d8\u306b\u3001PythonOperator \u3082\u4f4d\u7f6e\u5f15\u6570\u3068\u30ad\u30fc\u30ef\u30fc\u30c9\u5f15\u6570\u3092\u53d7\u3051\u5165\u308c\u308b\u3053\u3068\u304c\u3067\u304d\u3001\u30bf\u30b9\u30af \u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3092\u8ffd\u52a0\u306e\u5f15\u6570\u3068\u3057\u3066 Python \u95a2\u6570\u306b\u6e21\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>def print_hello(name):\n    print(f'Hello, {name}!')\n\ntask = PythonOperator(\n    task_id='print_hello',\n    python_callable=print_hello,\n    op_kwargs={'name': 'Airflow'},\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001\u5024\u304c \u3067\u3042\u308bPython \u95a2\u6570\u306b\u30ad\u30fc\u30ef\u30fc\u30c9\u5f15\u6570<code>print_hello<\/code>\u3092\u6e21\u3057\u307e\u3059\u3002\u5b9f\u884c\u6642\u306b\u3001PythonOperator \u306f Python \u95a2\u6570\u3092\u547c\u3073\u51fa\u3057\u3001\u30ad\u30fc\u30ef\u30fc\u30c9\u5f15\u6570\u3092\u5f15\u6570\u3068\u3057\u3066\u95a2\u6570\u306b\u6e21\u3057\u307e\u3059\u3002\u95a2\u6570\u672c\u4f53\u306e\u30b3\u30fc\u30c9\u306f\u3001\u300cHello, Airflow!\u300d\u3092\u51fa\u529b\u3057\u307e\u3059\u3002<code>name<\/code><code>'Airflow'<\/code><\/p>\n\n\n\n<p>\u8981\u3059\u308b\u306b\u3001PythonOperator \u306f Airflow \u306e\u975e\u5e38\u306b\u5b9f\u7528\u7684\u306a\u7d44\u307f\u8fbc\u307f Operator \u3067\u3042\u308a\u3001\u3055\u307e\u3056\u307e\u306a Python \u95a2\u6570\u3092\u5b9f\u884c\u3057\u3066\u8907\u96d1\u306a\u30d3\u30eb\u30c9\u3092\u4f5c\u6210\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d44\u307f\u8fbc\u307f\u306e\u6f14\u7b97\u5b50 BranchOperator \u3092\u4f7f\u7528\u3057\u3066\u8a73\u7d30\u306b\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001BranchOperator \u306f\u7d44\u307f\u8fbc\u307f\u306e Operator \u3067\u3042\u308a\u3001\u30bf\u30b9\u30af\u306e\u7d50\u679c\u306b\u57fa\u3065\u3044\u3066\u5b9f\u884c\u30d1\u30b9\u3092\u52d5\u7684\u306b\u9078\u629e\u3057\u307e\u3059\u3002\u901a\u5e38\u3001\u30bf\u30b9\u30af\u30d7\u30ed\u30bb\u30b9\u306e\u5206\u5c90\u3068\u30de\u30fc\u30b8\u3092\u5236\u5fa1\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u3001\u3055\u307e\u3056\u307e\u306a\u6761\u4ef6\u306b\u5fdc\u3058\u3066\u3055\u307e\u3056\u307e\u306a\u5b9f\u884c\u30d1\u30b9\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>BranchOperator \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>task_id<\/code>: \u4e00\u610f\u3067\u3042\u308b\u5fc5\u8981\u304c\u3042\u308b\u30bf\u30b9\u30af\u306e ID\u3002<\/li>\n\n\n\n<li><code>python_callable<\/code>: \u5b9f\u884c\u3059\u308b Python \u95a2\u6570\u3002\u95a2\u6570\u306f\u3001\u5b9f\u884c\u3059\u308b\u30bf\u30b9\u30af ID \u3092\u8868\u3059\u6587\u5b57\u5217\u3092\u8fd4\u3059\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u95a2\u6570\u306f\u3001\u95a2\u6570\u3001\u30e1\u30bd\u30c3\u30c9\u3001\u547c\u3073\u51fa\u3057\u53ef\u80fd\u3001\u307e\u305f\u306f\u30d1\u30b9\u6587\u5b57\u5217\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u30d1\u30b9\u6587\u5b57\u5217\u306e\u5834\u5408\u3001\u95a2\u6570\u306f\u305d\u306e\u30d1\u30b9\u306b\u5f93\u3063\u3066\u30a4\u30f3\u30dd\u30fc\u30c8\u304a\u3088\u3073\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>op_args<\/code>: \u30ea\u30b9\u30c8\u3068\u3057\u3066\u63d0\u4f9b\u3055\u308c\u308b Python \u95a2\u6570\u3078\u306e\u4f4d\u7f6e\u5f15\u6570\u3002<\/li>\n\n\n\n<li><code>op_kwargs<\/code>: \u8f9e\u66f8\u3068\u3057\u3066\u63d0\u4f9b\u3055\u308c\u308b\u3001Python \u95a2\u6570\u3078\u306e\u30ad\u30fc\u30ef\u30fc\u30c9\u5f15\u6570\u3002<\/li>\n\n\n\n<li><code>dag<\/code>: \u6240\u5c5e\u7684 DAG\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u6b21\u306b\u3001BranchOperator \u3092\u4f7f\u7528\u3057\u3066\u7c21\u5358\u306a\u5206\u5c90\u64cd\u4f5c\u3092\u5b9f\u884c\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u4f8b\u3092\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom airflow.operators.python_operator import BranchOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ndef decide_what_to_do():\n    if datetime.today().weekday() == 0:\n        return 'print_date'\n    else:\n        return 'print_hello'\n\nbranch_task = BranchOperator(\n    task_id='branch_task',\n    python_callable=decide_what_to_do,\n    dag=dag,\n)\n\nprint_date_task = BashOperator(\n    task_id='print_date',\n    bash_command='date',\n    dag=dag,\n)\n\nprint_hello_task = BashOperator(\n    task_id='print_hello',\n    bash_command='echo \"Hello, world!\"',\n    dag=dag,\n)\n\nbranch_task &gt;&gt; [print_date_task, print_hello_task]\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001BranchOperator \u3092\u4f7f\u7528\u3057\u3066 Task<code>branch_task<\/code>\u3068\u3044\u3046\u540d\u524d\u3001Python \u95a2\u6570\u3092\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc<code>decide_what_to_do<\/code>\u3068\u3057\u3066BranchOperator \u306b\u6e21\u3057\u307e\u3059\u3002<code>python_callable<\/code>\u5b9f\u884c\u6642\u3001BranchOperator \u306f\u3053\u306e Python \u95a2\u6570\u3092\u547c\u3073\u51fa\u3057\u3001\u8fd4\u3055\u308c\u305f\u7d50\u679c\u306b\u5f93\u3063\u3066\u5b9f\u884c\u3059\u308b\u30bf\u30b9\u30af\u3092\u9078\u629e\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>Python \u95a2\u6570<code>decide_what_to_do<\/code>\u3067\u306f\u3001\u73fe\u5728\u306e\u65e5\u4ed8\u306e\u9031\u756a\u53f7\u306b\u5f93\u3063\u3066\u5b9f\u884c\u3059\u308b\u30bf\u30b9\u30af\u3092\u6c7a\u5b9a\u3057\u307e\u3059. \u6708\u66dc\u65e5\u3067\u3042\u308c\u3070<code>print_date<\/code>\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u3053\u3068\u3092\u9078\u629e\u3057\u3001\u305d\u308c\u4ee5\u5916\u306e\u5834\u5408\u306f<code>print_hello<\/code>\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u3053\u3068\u3092\u9078\u629e\u3057\u307e\u3059.<\/p>\n\n\n\n<p>DAG \u30c0\u30a4\u30a2\u30b0\u30e9\u30e0\u3067\u306f\u3001 \u306e\u51fa\u529b\u304c\u306e\u5165\u529b\u3068\u3057\u3066\u4f7f\u7528\u3055\u308c\u3001\u6b21\u306b\u5b9f\u884c\u3059\u308b\u30bf\u30b9\u30af\u3092\u6c7a\u5b9a\u3059\u308b\u3053\u3068<code>branch_task<\/code>\u304c\u308f\u304b\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u73fe\u5728\u306e\u65e5\u4ed8\u304c\u6708\u66dc\u65e5\u306e\u5834\u5408\u3001\u51fa\u529b\u306f\u306b\u306a\u308a\u3001Task \u304c\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<code>print_date<\/code><code>print_hello<\/code><code>branch_task<\/code><code>'print_date'<\/code><code>print_date<\/code><\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001BranchOperator \u306f\u3001\u30bf\u30b9\u30af\u306e\u7d50\u679c\u306b\u5fdc\u3058\u3066\u4f7f\u7528\u3067\u304d\u308b\u3001\u975e\u5e38\u306b\u4fbf\u5229\u306a Airflow \u306e\u7d44\u307f\u8fbc\u307f Operator \u3067\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u5b9f\u884c\u30d1\u30b9\u3092\u52d5\u7684\u306b\u9078\u629e\u3057\u3001\u5206\u5c90\u3068\u30de\u30fc\u30b8\u306e\u5236\u5fa1\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002BranchOperator \u3092\u5408\u7406\u7684\u306b\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001\u8907\u96d1\u306a\u30bf\u30b9\u30af \u30d7\u30ed\u30bb\u30b9\u3092\u69cb\u7bc9\u3057\u3066\u3001\u3088\u308a\u67d4\u8edf\u306a\u30bf\u30b9\u30af \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d44\u307f\u8fbc\u307f\u306e\u6f14\u7b97\u5b50 SubDagOperator \u3092\u4f7f\u7528\u3057\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001SubDagOperator \u306f DAG \u3092\u5225\u306e DAG \u5185\u306b\u30cd\u30b9\u30c8\u3059\u308b\u305f\u3081\u306e\u7d44\u307f\u8fbc\u307f Operator \u3067\u3059\u3002\u3053\u308c\u306f\u901a\u5e38\u3001\u5927\u304d\u306a DAG \u3092\u8907\u6570\u306e\u30b5\u30d6 DAG \u306b\u5206\u5272\u3057\u3066\u3001\u7ba1\u7406\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u6539\u5584\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>SubDagOperator \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>task_id<\/code>: \u4e00\u610f\u3067\u3042\u308b\u5fc5\u8981\u304c\u3042\u308b\u30bf\u30b9\u30af\u306e ID\u3002<\/li>\n\n\n\n<li><code>subdag<\/code>: \u30cd\u30b9\u30c8\u3059\u308b DAG \u306f\u3001DAG \u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3067\u3042\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>default_args<\/code>: \u5b50 DAG \u306b\u6e21\u3055\u308c\u308b\u65e2\u5b9a\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u3001\u30c7\u30a3\u30af\u30b7\u30e7\u30ca\u30ea\u3067\u3042\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u6307\u5b9a\u3057\u306a\u3044\u5834\u5408\u3001\u30c7\u30d5\u30a9\u30eb\u30c8\u3067\u89aa DAG \u306e\u30c7\u30d5\u30a9\u30eb\u30c8 \u30d1\u30e9\u30e1\u30fc\u30bf\u304c\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>dag<\/code>: \u6240\u5c5e\u7684 DAG\u3002<\/li>\n<\/ul>\n\n\n\n<p>SubDagOperator \u3092\u4f7f\u7528\u3057\u3066 DAG \u3092\u5225\u306e DAG \u5185\u306b\u30cd\u30b9\u30c8\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3059\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.subdag_operator import SubDagOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'my_username',\n    'depends_on_past': False,\n    'start_date': datetime(2023, 1, 1),\n    'email': ['my_email@example.com'],\n    'email_on_failure': False,\n    'email_on_retry': False,\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5),\n}\n\ndag = DAG(\n    'my_dag',\n    default_args=default_args,\n    description='My first DAG with Airflow',\n    schedule_interval=timedelta(days=1),\n)\n\ndef subdag(parent_dag_id, child_dag_id, default_args):\n    subdag = DAG(\n        dag_id=f'{parent_dag_id}.{child_dag_id}',\n        default_args=default_args,\n        description='SubDAG example',\n        schedule_interval=timedelta(days=1),\n    )\n\n    task1 = BashOperator(\n        task_id='subdag_task1',\n        bash_command='echo \"Hello, from SubDAG!\"',\n        dag=subdag,\n    )\n\n    return subdag\n\nsubdag_task = SubDagOperator(\n    task_id='subdag_task',\n    subdag=subdag('my_dag', 'subdag', default_args),\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u3053\u3053\u3067\u306f\u3001\u5b50 DAG \u3092\u4f5c\u6210\u3059\u308b\u305f\u3081\u306b\u547c\u3073\u51fa\u3055\u308c\u308b Python<code>subdag<\/code>\u95a2\u6570\u3002\u6b21\u306b\u3001SubDagOperator \u3092\u4f7f\u7528\u3057\u3066<code>subdag_task<\/code>\u540d\u524d\u4ed8\u304d\u306e\u3001<code>subdag<\/code>\u95a2\u6570\u3092<code>subdag<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fcSubDagOperator \u306b\u6e21\u3057\u307e\u3059\u3002\u5b9f\u884c\u3055\u308c\u308b\u3068\u3001SubDagOperator \u306f Python \u95a2\u6570\u3092\u547c\u3073\u51fa\u3057\u3001\u30b5\u30d6 DAG \u3092\u4f5c\u6210\u3057\u3001\u30b5\u30d6 DAG \u3092\u30bf\u30b9\u30af\u3068\u3057\u3066\u89aa DAG \u306b\u8ffd\u52a0\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>subDAG \u3067\u306f\u3001\u300cHello, from SubDAG!\u300d\u3092\u51fa\u529b\u3059\u308b<code>subdag_task1<\/code>\u3068\u3044\u3046\u540d\u524d\u306e\u3002DAG \u30c0\u30a4\u30a2\u30b0\u30e9\u30e0\u3067\u306f\u3001\u30bf\u30b9\u30af\u3092\u542b\u3080\u30b5\u30d6 DAG<code>subdag_task<\/code>\u304c\u542b\u307e\u308c\u3066\u3044\u308b\u3053\u3068\u304c\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001SubDagOperator \u306f Airflow \u306e\u975e\u5e38\u306b\u5b9f\u7528\u7684\u306a\u7d44\u307f\u8fbc\u307f Operator \u3067\u3042\u308a\u3001DAG \u3092\u5225\u306e DAG \u306b\u30cd\u30b9\u30c8\u3057\u3066\u3001\u7ba1\u7406\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u6539\u5584\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30d3\u30eb\u30c8\u30a4\u30f3 Operator \u3068\u305d\u306e\u4ed6\u306e\u4e00\u822c\u7684\u306a Operator \u306e\u4f7f\u7528\u65b9\u6cd5\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u306b\u306f\u3001BashOperator\u3001PythonOperator\u3001BranchOperator\u3001\u304a\u3088\u3073 SubDagOperator \u306b\u52a0\u3048\u3066\u3001\u6b21\u306e\u3088\u3046\u306a\u4ed6\u306e\u591a\u304f\u306e\u4e00\u822c\u7684\u306a\u7d44\u307f\u8fbc\u307f Operator \u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>DummyOperator<\/li>\n<\/ol>\n\n\n\n<p>DummyOperator \u306f\u3001\u64cd\u4f5c\u3092\u5b9f\u884c\u305b\u305a\u3001\u30d7\u30ec\u30fc\u30b9\u30db\u30eb\u30c0\u30fc\u307e\u305f\u306f\u63a5\u7d9a\u30bf\u30b9\u30af\u3068\u3057\u3066\u306e\u307f\u4f7f\u7528\u3055\u308c\u308b\u30c0\u30df\u30fc Operator \u3067\u3059\u3002DummyOperator \u306f\u3001\u306a\u3069\u3092<code>task_id<\/code>\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<code>dag<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>BashOperator<\/li>\n<\/ol>\n\n\n\n<p>BashOperator \u306f\u3001\u30b7\u30a7\u30eb \u30b9\u30af\u30ea\u30d7\u30c8\u3001Python \u30b9\u30af\u30ea\u30d7\u30c8\u3001Linux \u30b3\u30de\u30f3\u30c9\u306a\u3069\u3001\u4efb\u610f\u306e Bash \u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<code>task_id<\/code>BashOperator \u306f\u3001 \u3001<code>bash_command<\/code>\u306a\u3069\u306e\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>xcom_push<\/code>\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>PythonVirtualenvOperator<\/li>\n<\/ol>\n\n\n\n<p>PythonVirtualenvOperator \u306f\u3001\u4eee\u60f3\u74b0\u5883\u3067 Python \u95a2\u6570\u307e\u305f\u306f\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002\u4eee\u60f3\u74b0\u5883\u3078\u306e\u30d1\u30b9\u3068\u3001\u5b9f\u884c\u3059\u308b Python \u95a2\u6570\u307e\u305f\u306f\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<code>task_id<\/code>PythonVirtualenvOperator \u306f\u3001<code>python_callable<\/code>\u3001<code>requirements<\/code>\u3001<code>system_site_packages<\/code>\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u30e1\u30fc\u30eb\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/li>\n<\/ol>\n\n\n\n<p>EmailOperator \u3092\u4f7f\u7528\u3057\u3066\u3001\u96fb\u5b50\u30e1\u30fc\u30eb\u901a\u77e5\u3092\u9001\u4fe1\u3067\u304d\u307e\u3059\u3002\u53d7\u4fe1\u8005\u3001\u4ef6\u540d\u3001\u30e1\u30c3\u30bb\u30fc\u30b8\u672c\u6587\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<code>task_id<\/code>EmailOperator \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>to<\/code>\u3002<code>subject<\/code><code>html_content<\/code><code>files<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>FTP\u30bb\u30f3\u30b5\u30fc<\/li>\n<\/ol>\n\n\n\n<p>FTPSensor \u306f\u3001FTP \u30b5\u30fc\u30d0\u30fc\u4e0a\u306e\u30d5\u30a1\u30a4\u30eb\u306e\u5b58\u5728\u3092\u76e3\u8996\u3057\u3001\u30d5\u30a1\u30a4\u30eb\u304c\u5b58\u5728\u3059\u308b\u5834\u5408\u306b\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u30c8\u30ea\u30ac\u30fc\u3067\u304d\u307e\u3059\u3002<code>task_id<\/code>FTPSensor \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>ftp_conn_id<\/code>\u3002<code>filepath<\/code><code>timeout<\/code><code>poke_interval<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"6\">\n<li>HttpSensor<\/li>\n<\/ol>\n\n\n\n<p>HttpSensor \u306f\u3001URL \u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u308b\u304b\u3069\u3046\u304b\u3092\u76e3\u8996\u3057\u3001URL \u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u308b\u5834\u5408\u306b\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u30c8\u30ea\u30ac\u30fc\u3067\u304d\u307e\u3059\u3002HttpSensor \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b<code>task_id<\/code>\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>http_conn_id<\/code>\u3002<code>endpoint<\/code><code>request_params<\/code><code>response_check<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"7\">\n<li>MySqlOperator<\/li>\n<\/ol>\n\n\n\n<p>MySqlOperator \u306f\u3001MySQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3067 SQL \u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002MySQL \u63a5\u7d9a ID\u3001SQL \u30b3\u30de\u30f3\u30c9\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002MySqlOperator \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b<code>task_id<\/code>\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>mysql_conn_id<\/code>\u3002<code>sql<\/code><code>database<\/code><code>autocommit<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"8\">\n<li>PostgresOperator<\/li>\n<\/ol>\n\n\n\n<p>PostgresOperator \u306f\u3001PostgreSQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3067 SQL \u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002PostgreSQL \u63a5\u7d9a ID\u3001SQL \u30b3\u30de\u30f3\u30c9\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002PostgresOperator \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b<code>task_id<\/code>\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>postgres_conn_id<\/code>\u3002<code>sql<\/code><code>database<\/code><code>autocommit<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"9\">\n<li>S3KeySensor<\/li>\n<\/ol>\n\n\n\n<p>S3KeySensor \u306f\u3001Amazon S3 \u4e0a\u306e\u30d5\u30a1\u30a4\u30eb\u306e\u5b58\u5728\u3092\u76e3\u8996\u3057\u3001\u30d5\u30a1\u30a4\u30eb\u304c\u5b58\u5728\u3059\u308b\u5834\u5408\u306b\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u30c8\u30ea\u30ac\u30fc\u3067\u304d\u307e\u3059\u3002S3KeySensor \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b<code>task_id<\/code>\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>bucket_key<\/code>\u3002<code>bucket_name<\/code><code>wildcard_match<\/code><code>timeout<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"10\">\n<li>S3<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"10\">\n<li>S3CopyObjectOperator<\/li>\n<\/ol>\n\n\n\n<p>S3CopyObjectOperator \u306f\u3001Amazon S3 \u4e0a\u306e\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u5225\u306e\u5834\u6240\u306b\u30b3\u30d4\u30fc\u3067\u304d\u307e\u3059\u3002\u30bd\u30fc\u30b9 \u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3001\u5b9b\u5148\u306e\u5834\u6240\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002S3CopyObjectOperator \u306f\u3001\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092<code>task_id<\/code>\u53d7\u3051\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>source_bucket_key<\/code>\u3002<code>source_bucket_name<\/code><code>dest_bucket_key<\/code><code>dest_bucket_name<\/code><code>extra_args<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"11\">\n<li>S3DeleteObjectsOperator<\/li>\n<\/ol>\n\n\n\n<p>S3DeleteObjectsOperator \u306f\u3001Amazon S3 \u4e0a\u306e 1 \u3064\u4ee5\u4e0a\u306e\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u524a\u9664\u3067\u304d\u307e\u3059\u3002\u524a\u9664\u3059\u308b\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u306e\u30ea\u30b9\u30c8\u3068\u305d\u306e\u4ed6\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002S3DeleteObjectsOperator \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b<code>task_id<\/code>\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>bucket<\/code>\u3002<code>keys<\/code><code>version_ids<\/code><code>extra_args<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"12\">\n<li>SlackAPIOperator<\/li>\n<\/ol>\n\n\n\n<p>SlackAPIOperator \u306f Slack \u30c1\u30e3\u30cd\u30eb\u306b\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u9001\u4fe1\u3067\u304d\u307e\u3059\u3002\u30e1\u30c3\u30bb\u30fc\u30b8 \u30c6\u30ad\u30b9\u30c8\u3001Slack \u63a5\u7d9a ID\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002SlackAPIOperator \u306f\u3001\u3001\u3001\u3001\u3001\u306a\u3069\u3092\u542b\u3080\u8907\u6570\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u53d7\u3051\u53d6\u308b<code>task_id<\/code>\u3053\u3068\u304c\u3067\u304d\u307e\u3059<code>slack_conn_id<\/code>\u3002<code>channel<\/code><code>text<\/code><code>attachments<\/code><\/p>\n\n\n\n<p>\u3053\u308c\u3089\u306e\u4e00\u822c\u7684\u306a\u7d44\u307f\u8fbc\u307f Operator \u306f\u3001\u30b7\u30a7\u30eb \u30b3\u30de\u30f3\u30c9\u306e\u5b9f\u884c\u304b\u3089\u96fb\u5b50\u30e1\u30fc\u30eb\u3084 Slack \u30e1\u30c3\u30bb\u30fc\u30b8\u306e\u9001\u4fe1\u307e\u3067\u3001\u591a\u304f\u306e\u4e00\u822c\u7684\u306a\u30bf\u30b9\u30af\u306e\u30cb\u30fc\u30ba\u3092\u6e80\u305f\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u65e2\u6210\u306e Operator \u304c\u5229\u7528\u3067\u304d\u306a\u3044\u5834\u5408\u306f\u3001\u7279\u5b9a\u306e\u30bf\u30b9\u30af\u8981\u4ef6\u3092\u6e80\u305f\u3059\u305f\u3081\u306b\u72ec\u81ea\u306e Operator \u3092\u4f5c\u6210\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow\u30bf\u30b9\u30af\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u30fc\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u306e\u5c0e\u5165\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u306f Scheduler \u3068 Executor \u306b\u3088\u3063\u3066\u5b9f\u88c5\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u306f Airflow \u306e\u30b3\u30a2 \u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u306e 1 \u3064\u3067\u3001DAG \u3068\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u7ba1\u7406\u3057\u307e\u3059\u3002\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u306f\u3001\u6307\u5b9a\u3055\u308c\u305f\u6642\u9593\u9593\u9694\u5185\u306b\u672a\u5b8c\u4e86\u306e\u30bf\u30b9\u30af\u3092\u30c1\u30a7\u30c3\u30af\u3057\u3001\u5b9f\u884c\u3067\u304d\u308b\u30bf\u30b9\u30af\u3092\u5224\u65ad\u3057\u3066\u304b\u3089\u3001\u5b9f\u884c\u306e\u305f\u3081\u306b\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u306b\u9001\u4fe1\u3057\u307e\u3059\u3002\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u306f\u901a\u5e38\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3068\u5bfe\u8a71\u3057\u3066\u3001DAG \u3068\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3001\u304a\u3088\u3073\u8a08\u753b\u3055\u308c\u305f\u5b9f\u884c\u6642\u9593\u306a\u3069\u306e\u60c5\u5831\u3092\u5224\u65ad\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>Executor \u306f Airflow \u306e\u3082\u3046 1 \u3064\u306e\u30b3\u30a2 \u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3042\u308a\u3001DAG \u3068\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u53ef\u80fd\u306a\u30bf\u30b9\u30af\u306b\u5909\u63db\u3057\u307e\u3059\u3002\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u306f\u3001\u30ed\u30fc\u30ab\u30eb\u307e\u305f\u306f\u30ea\u30e2\u30fc\u30c8 \u30b5\u30fc\u30d0\u30fc\u3067\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u306f\u901a\u5e38\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u3084\u308a\u53d6\u308a\u3057\u3066\u3001\u5b9f\u884c\u3059\u308b\u30bf\u30b9\u30af\u306b\u95a2\u3059\u308b\u60c5\u5831\u3092\u53d6\u5f97\u3057\u3001\u305d\u308c\u3092\u5b9f\u884c\u53ef\u80fd\u306a\u30bf\u30b9\u30af\u306b\u5909\u63db\u3057\u3066\u304b\u3089\u3001\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u3044\u304f\u3064\u304b\u306e\u30bf\u30a4\u30d7\u306e\u30a2\u30af\u30c1\u30e5\u30a8\u30fc\u30bf\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>LocalExecutor<\/li>\n<\/ol>\n\n\n\n<p>LocalExecutor \u306f Airflow \u306e\u7d44\u307f\u8fbc\u307f\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3067\u3042\u308a\u3001\u30ed\u30fc\u30ab\u30eb \u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc\u3067\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002LocalExecutor \u306f\u3001\u5b9f\u884c\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u305f\u3081\u306b\u3001\u30ed\u30fc\u30ab\u30eb \u30de\u30b7\u30f3\u4e0a\u3067\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>SequentialExecutor<\/li>\n<\/ol>\n\n\n\n<p>SequentialExecutor \u306f Airflow \u306e\u7d44\u307f\u8fbc\u307f\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3067\u3082\u3042\u308a\u3001DAG \u3067\u5b9a\u7fa9\u3055\u308c\u305f\u9806\u5e8f\u3067\u30bf\u30b9\u30af\u3092 1 \u3064\u305a\u3064\u5b9f\u884c\u3057\u307e\u3059\u3002SequentialExecutor \u306f 1 \u3064\u306e\u30d7\u30ed\u30bb\u30b9\u3067\u3057\u304b\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u306a\u3044\u305f\u3081\u3001\u4e26\u5217\u5b9f\u884c\u306f\u5b9f\u73fe\u3067\u304d\u307e\u305b\u3093\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30bb\u30ed\u30ea\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf<\/li>\n<\/ol>\n\n\n\n<p>CeleryExecutor \u306f\u3001Celery \u30e1\u30c3\u30bb\u30fc\u30b8 \u30ad\u30e5\u30fc \u30b7\u30b9\u30c6\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u5206\u6563\u30bf\u30b9\u30af\u5b9f\u884c\u3092\u5b9f\u88c5\u3057\u307e\u3059\u3002CeleryExecutor \u306f\u3001\u8907\u6570\u306e\u30ea\u30e2\u30fc\u30c8 \u30b5\u30fc\u30d0\u30fc\u3067\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3057\u3001\u5b9f\u884c\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002CeleryExecutor \u306f\u3001\u7570\u306a\u308b Celery \u30ad\u30e5\u30fc\u3092\u8a2d\u5b9a\u3059\u308b\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u512a\u5148\u5ea6\u3092\u5236\u5fa1\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>KubernetesExecutor<\/li>\n<\/ol>\n\n\n\n<p>KubernetesExecutor \u306f\u3001Kubernetes \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30b7\u30b9\u30c6\u30e0\u3092\u4f7f\u7528\u3057\u3066\u5206\u6563\u30bf\u30b9\u30af\u5b9f\u884c\u3092\u5b9f\u73fe\u3059\u308b\u6bd4\u8f03\u7684\u65b0\u3057\u3044\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3067\u3059\u3002KubernetesExecutor \u306f\u3001\u8907\u6570\u306e Kubernetes Pod \u3067\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3067\u304d\u308b\u305f\u3081\u3001\u5b9f\u884c\u52b9\u7387\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002KubernetesExecutor \u306f\u3001Kubernetes \u306e\u30ea\u30bd\u30fc\u30b9\u7ba1\u7406\u6a5f\u80fd\u3092\u4f7f\u7528\u3057\u3066\u3001Task \u306e\u30ea\u30bd\u30fc\u30b9\u4f7f\u7528\u3092\u5236\u5fa1\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3068\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u306f Airflow \u306e 2 \u3064\u306e\u91cd\u8981\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3042\u308a\u3001DAG \u3068\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u3092\u62c5\u5f53\u3057\u307e\u3059\u3002Airflow \u306f\u8907\u6570\u306e\u30bf\u30a4\u30d7\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u304a\u308a\u3001\u30bf\u30b9\u30af\u306e\u8981\u4ef6\u306b\u5f93\u3063\u3066\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u9069\u5207\u306a\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>LocalExecutor \u3068 CeleryExecutor \u3092\u4f7f\u7528\u3057\u305f Airflow \u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u306f\u3001LocalExecutor\u3001SequentialExecutor\u3001CeleryExecutor\u3001KubernetesExecutor \u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30bf\u30a4\u30d7\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u3053\u3067\u306f\u3001LocalExecutor \u3068 CeleryExecutor \u306e\u4f7f\u7528\u306b\u7126\u70b9\u3092\u5f53\u3066\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">LocalExecutor<\/h2>\n\n\n\n<p>LocalExecutor \u306f Airflow \u306e\u7d44\u307f\u8fbc\u307f\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3067\u3042\u308a\u3001\u30ed\u30fc\u30ab\u30eb \u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc\u3067\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002LocalExecutor \u306f\u3001\u5b9f\u884c\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u305f\u3081\u306b\u3001\u30ed\u30fc\u30ab\u30eb \u30de\u30b7\u30f3\u4e0a\u3067\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>LocalExecutor \u3092\u4f7f\u7528\u3059\u308b\u306b\u306f\u3001Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u306e\u69cb\u6210\u304c\u5fc5\u8981\u3067\u3059\u3002LocalExecutor \u3092\u4f7f\u7528\u3057\u305f\u69cb\u6210\u306e\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">makefile\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>executor = LocalExecutor\nparallelism = 4\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u69cb\u6210\u3067\u306f\u3001executor \u3092 LocalExecutor \u3068\u3057\u3066\u8a2d\u5b9a\u3057\u3001\u4e26\u5217\u51e6\u7406\u3092 4 \u306b\u8a2d\u5b9a\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u308c\u306f\u3001LocalExecutor \u304c\u540c\u6642\u306b 4 \u3064\u306e\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u308b\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>LocalExecutor \u3092\u4f7f\u7528\u3057\u3066 Task \u3092\u5b9f\u884c\u3059\u308b\u30d7\u30ed\u30bb\u30b9\u306f\u3001\u4ed6\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3068\u540c\u69d8\u3067\u3042\u308a\u3001DAG \u3067\u5bfe\u5fdc\u3059\u308b\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u6307\u5b9a\u3059\u308b\u3060\u3051\u3067\u6e08\u307f\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u30bb\u30ed\u30ea\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf<\/h2>\n\n\n\n<p>CeleryExecutor \u306f\u3001Celery \u30e1\u30c3\u30bb\u30fc\u30b8 \u30ad\u30e5\u30fc \u30b7\u30b9\u30c6\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u5206\u6563\u30bf\u30b9\u30af\u5b9f\u884c\u3092\u5b9f\u88c5\u3057\u307e\u3059\u3002CeleryExecutor \u306f\u3001\u8907\u6570\u306e\u30ea\u30e2\u30fc\u30c8 \u30b5\u30fc\u30d0\u30fc\u3067\u8907\u6570\u306e\u30bf\u30b9\u30af\u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3057\u3001\u5b9f\u884c\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002CeleryExecutor \u306f\u3001\u7570\u306a\u308b Celery \u30ad\u30e5\u30fc\u3092\u8a2d\u5b9a\u3059\u308b\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u512a\u5148\u5ea6\u3092\u5236\u5fa1\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>CeleryExecutor \u3092\u4f7f\u7528\u3059\u308b\u306b\u306f\u3001\u307e\u305a Celery \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u69cb\u6210\u3057\u3001\u6b21\u306b Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u69cb\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002CeleryExecutor \u3092\u4f7f\u7528\u3057\u305f\u69cb\u6210\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">perl\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>executor = CeleryExecutor\ncelery_result_backend = db+postgresql:\/\/airflow_user:airflow_pass@localhost:5432\/airflow\ncelery_broker_url = amqp:\/\/guest:guest@localhost:5672\/\/\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u69cb\u6210\u3067\u306f\u3001\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092 CeleryExecutor \u3068\u3057\u3066\u30bb\u30c3\u30c8\u30a2\u30c3\u30d7\u3057\u3001Celery \u3092\u7d50\u679c\u306e\u30d0\u30c3\u30af\u30a8\u30f3\u30c9\u304a\u3088\u3073\u30e1\u30c3\u30bb\u30fc\u30b8 \u30d6\u30ed\u30fc\u30ab\u30fc\u3068\u3057\u3066\u4f7f\u7528\u3057\u307e\u3059\u3002\u307e\u305f\u3001\u30ef\u30fc\u30ab\u30fc\u6570\u3001\u30ad\u30e5\u30fc\u540d\u306a\u3069\u3001Celery \u3067\u95a2\u9023\u3059\u308b\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u69cb\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<p>CeleryExecutor \u3092\u4f7f\u7528\u3057\u3066 Task \u3092\u5b9f\u884c\u3059\u308b\u30d7\u30ed\u30bb\u30b9\u306f\u3001\u4ed6\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3068\u4f3c\u3066\u3044\u307e\u3059\u3002DAG \u3067\u5bfe\u5fdc\u3059\u308b\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u6307\u5b9a\u3059\u308b\u3060\u3051\u3067\u6e08\u307f\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001LocalExecutor \u3068 CeleryExecutor \u306f Airflow \u3067\u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b 2 \u3064\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3067\u3042\u308a\u3001\u30bf\u30b9\u30af\u306e\u8981\u4ef6\u306b\u5f93\u3063\u3066\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u305f\u3081\u306b\u9069\u5207\u306a\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002LocalExecutor \u3092\u9078\u629e\u3057\u3066\u30ed\u30fc\u30ab\u30eb \u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc\u3067\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3057\u3001CeleryExecutor \u3092\u9078\u629e\u3057\u3066\u5206\u6563\u74b0\u5883\u3067\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u69cb\u6210\u306e\u4e26\u5217\u30bf\u30b9\u30af\u3068\u30ea\u30bd\u30fc\u30b9\u306e\u5236\u9650<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u4e26\u5217\u30bf\u30b9\u30af\u3068\u30ea\u30bd\u30fc\u30b9\u5236\u9650\u3092\u6b21\u306e 2 \u3064\u306e\u65b9\u6cd5\u3067\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u4e26\u5217\u30bf\u30b9\u30af<\/li>\n<\/ol>\n\n\n\n<p>\u4e26\u5217\u30bf\u30b9\u30af\u306e\u6570\u306f\u3001\u8a2d\u5b9a<code>parallelism<\/code>\u3068\u3002<code>dag_concurrency<\/code><\/p>\n\n\n\n<p><code>parallelism<\/code>\u5358\u4e00\u306e DAG \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u5185\u306e\u4e26\u5217\u30bf\u30b9\u30af\u306e\u6570\u3092\u5236\u5fa1\u3057\u306a\u304c\u3089\u3001\u3059\u3079\u3066\u306e DAG \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u306b\u308f\u305f\u308b\u4e26\u5217\u30bf\u30b9\u30af\u306e\u6570<code>dag_concurrency<\/code>\u3092\u5236\u5fa1\u3057\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u306e\u5024\u306f\u3001\u30bf\u30b9\u30af\u306e\u8981\u4ef6\u306b\u5f93\u3063\u3066\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u305f\u3068\u3048\u3070\u3001\u6b21\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u3092 Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">makefile\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>parallelism = 16\ndag_concurrency = 4\n<\/code><\/pre>\n\n\n\n<p>\u3053\u308c\u306b\u3088\u308a\u3001\u3059\u3079\u3066\u306e DAG \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3067\u6700\u5927 16 \u306e\u30bf\u30b9\u30af\u3092\u4e26\u884c\u3057\u3066\u5b9f\u884c\u3067\u304d\u3001\u5358\u4e00\u306e DAG \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u5185\u3067\u6700\u5927 4 \u3064\u306e\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30ea\u30bd\u30fc\u30b9\u306e\u5236\u7d04<\/li>\n<\/ol>\n\n\n\n<p>DAG \u306e Task \u3067<code>resources<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u3002<\/p>\n\n\n\n<p><code>resources<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u306f\u3001\u30bf\u30b9\u30af\u306b\u3088\u3063\u3066\u4f7f\u7528\u3055\u308c\u308b CPU\u3001\u30e1\u30e2\u30ea\u3001\u30c7\u30a3\u30b9\u30af\u5bb9\u91cf\u306a\u3069\u306e\u30ea\u30bd\u30fc\u30b9\u306e\u5236\u9650\u3092\u542b\u3080\u30c7\u30a3\u30af\u30b7\u30e7\u30ca\u30ea\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task = BashOperator(\n    task_id='my_task',\n    bash_command='echo \"Hello, World!\"',\n    resources={'cpu': 1, 'memory': 2048},\n    dag=dag\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u30b3\u30fc\u30c9\u3067\u306f\u3001<code>resources<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306b\u3088\u3063\u3066\u3001\u30bf\u30b9\u30af\u304c\u4f7f\u7528\u3059\u308b CPU \u3092 1 \u306b\u3001\u30e1\u30e2\u30ea\u3092 2048 MB \u306b\u5236\u9650\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow Web UI \u3067\u30bf\u30b9\u30af\u306e\u30ea\u30bd\u30fc\u30b9\u4f7f\u7528\u91cf\u3092\u8868\u793a\u3057\u3066\u3001\u30ea\u30bd\u30fc\u30b9\u5236\u9650\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u8abf\u6574\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3067\u306f\u3001\u4e26\u5217\u30bf\u30b9\u30af\u306e\u6570\u3068\u30ea\u30bd\u30fc\u30b9\u5236\u9650\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u69cb\u6210\u3059\u308b\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306e\u4e26\u5217\u51e6\u7406\u3068\u30ea\u30bd\u30fc\u30b9\u4f7f\u7528\u3092\u5236\u5fa1\u3057\u3066\u3001\u3088\u308a\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30c8\u30ea\u30ac\u30fc\u8a2d\u5b9a\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u306f<code>depends_on_past<\/code>\u3001<code>trigger_rule<\/code>\u30bf\u30b9\u30af\u306e \u304a\u3088\u3073 \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u4ecb\u3057\u3066\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2<\/h2>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e<code>depends_on_past<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u304c\u524d\u306e\u5b9f\u884c\u306e\u7d50\u679c\u306b\u4f9d\u5b58\u3059\u308b\u304b\u3069\u3046\u304b\u3092\u6307\u5b9a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<code>depends_on_past<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u304c True \u306e\u5834\u5408\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306f\u3001\u524d\u306e\u5b9f\u884c\u304c\u6210\u529f\u3057\u305f\u5f8c\u306b\u306e\u307f\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002\u524d\u56de\u306e\u5b9f\u884c\u304c\u5931\u6557\u3057\u305f\u5834\u5408\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306f\u5b9f\u884c\u3055\u308c\u307e\u305b\u3093\u3002<\/p>\n\n\n\n<p>\u305f\u3068\u3048\u3070\u3001\u6b21\u306f<code>depends_on_past<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u304c\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task = BashOperator(\n    task_id='my_task',\n    bash_command='echo \"Hello, World!\"',\n    depends_on_past=True,\n    dag=dag\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306f\u3001\u524d\u56de\u306e\u5b9f\u884c\u304c\u6210\u529f\u3057\u305f\u5f8c\u306b\u306e\u307f\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002\u524d\u56de\u306e\u5b9f\u884c\u304c\u5931\u6557\u3057\u305f\u5834\u5408\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306f\u5b9f\u884c\u3055\u308c\u307e\u305b\u3093\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u30c8\u30ea\u30ac\u30fc\u8a2d\u5b9a<\/h2>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u3001\u30bf\u30b9\u30af\u304c\u30c8\u30ea\u30ac\u30fc\u3055\u308c\u308b\u72b6\u6cc1\u3092\u6307\u5b9a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u304c all_success \u306e\u5834\u5408\u3001\u30bf\u30b9\u30af\u306f\u3059\u3079\u3066\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u305f\u5f8c\u306b\u306e\u307f\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u304c one_success \u306e\u5834\u5408\u3001\u5c11\u306a\u304f\u3068\u3082 1 \u3064\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u305f\u5834\u5408\u306b\u306e\u307f\u3001\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u304c all_done \u306e\u5834\u5408\u3001\u30bf\u30b9\u30af\u306f\u3059\u3079\u3066\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u3055\u308c\u305f\u5f8c\u306b\u306e\u307f\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u304c one_failed \u306e\u5834\u5408\u3001\u4f9d\u5b58\u30bf\u30b9\u30af\u306e\u5c11\u306a\u304f\u3068\u3082 1 \u3064\u304c\u5931\u6557\u3057\u305f\u5834\u5408\u306b\u306e\u307f\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u305f\u3068\u3048\u3070\u3001\u4ee5\u4e0b\u306f<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>task = BashOperator(\n    task_id='my_task',\n    bash_command='echo \"Hello, World!\"',\n    trigger_rule='all_success',\n    dag=dag\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306f\u3001\u3059\u3079\u3066\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u305f\u5f8c\u306b\u306e\u307f\u5b9f\u884c\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u4e0a\u8a18\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306b\u52a0\u3048\u3066\u3001Airflow \u306f\u3001\u518d\u5e30\u7684\u306a\u4f9d\u5b58\u95a2\u4fc2\u3001\u30af\u30ed\u30b9 DAG \u306e\u4f9d\u5b58\u95a2\u4fc2\u306a\u3069\u3001\u4ed6\u306e\u30bf\u30a4\u30d7\u306e\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3082\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u4f9d\u5b58\u95a2\u4fc2\u306e\u7a2e\u985e\u306f\u3001\u3088\u308a\u67d4\u8edf\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u306e\u305f\u3081\u306b\u3001\u30bf\u30b9\u30af\u306e\u8981\u4ef6\u306b\u5f93\u3063\u3066\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u305f\u30c8\u30ea\u30ac\u30fc\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb (\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb) \u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u304c\u30c8\u30ea\u30ac\u30fc\u3055\u308c\u308b\u72b6\u6cc1\u3092\u6307\u5b9a\u3057\u307e\u3059\u3002\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u306f\u3001 Task \u3067<code>trigger_rule<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002<\/p>\n\n\n\n<p>Airflow \u306f\u3001\u6b21\u306e 4 \u3064\u306e\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>all_success: \u3059\u3079\u3066\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u305f\u3068\u304d\u306b\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u3092\u30c8\u30ea\u30ac\u30fc\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>all_failed: \u3059\u3079\u3066\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u306b\u5931\u6557\u3057\u305f\u3068\u304d\u306b\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u3092\u30c8\u30ea\u30ac\u30fc\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>all_done: \u3059\u3079\u3066\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u3055\u308c\u305f\u3068\u304d\u306b\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u3092\u30c8\u30ea\u30ac\u30fc\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>one_success: \u5c11\u306a\u304f\u3068\u3082 1 \u3064\u306e\u4f9d\u5b58\u30bf\u30b9\u30af\u304c\u6b63\u5e38\u306b\u5b9f\u884c\u3055\u308c\u305f\u3068\u304d\u306b\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u3092\u30c8\u30ea\u30ac\u30fc\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u306e\u4f7f\u7528\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"Task 1\"',\n    dag=dag,\n)\n\nt2 = BashOperator(\n    task_id='task_2',\n    bash_command='echo \"Task 2\"',\n    dag=dag,\n)\n\nt3 = BashOperator(\n    task_id='task_3',\n    bash_command='echo \"Task 3\"',\n    trigger_rule='all_success',\n    dag=dag,\n)\n\nt4 = BashOperator(\n    task_id='task_4',\n    bash_command='echo \"Task 4\"',\n    dag=dag,\n)\n\nt5 = BashOperator(\n    task_id='task_5',\n    bash_command='echo \"Task 5\"',\n    dag=dag,\n)\n\nt1 &gt;&gt; t2 &gt;&gt; t3\nt1 &gt;&gt; t4 &gt;&gt; t3\nt3 &gt;&gt; t5\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u30d1\u30e9\u30e1\u30fc\u30bf<code>task_3<\/code>\u306f \u306b\u8a2d\u5b9a\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u5b9f\u884c\u304c\u6210\u529f\u3057\u305f\u5834\u5408\u306b\u306e\u307f\u5b9f\u884c\u304c\u30c8\u30ea\u30ac\u30fc\u3055\u308c\u308b\u3053\u3068\u3092\u610f\u5473\u3057\u307e\u3059\u3002<code>trigger_rule<\/code><code>all_success<\/code><code>task_1<\/code><code>task_2<\/code><code>task_3<\/code><\/p>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e Web UI \u30da\u30fc\u30b8\u3067\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u3001\u3088\u308a\u67d4\u8edf\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u306e\u305f\u3081\u306b\u3001\u30bf\u30b9\u30af\u306e\u8981\u4ef6\u306b\u5f93\u3063\u3066\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc\u306e\u30c8\u30ea\u30ac\u30fc\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc (ExternalTask\u200b\u200bSensor) \u306f\u7279\u5225\u306a\u30bf\u30a4\u30d7\u306e Operator \u3067\u3042\u308a\u3001\u4ed6\u306e DAG \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u306e\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u3092\u5b8c\u4e86\u3057\u305f\u304b\u3069\u3046\u304b\u3092\u76e3\u8996\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002\u901a\u5e38\u3001\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc\u306f\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u3092\u5b9f\u884c\u3059\u308b\u524d\u306b\u4ed6\u306e\u30bf\u30b9\u30af\u304c\u5b8c\u4e86\u3059\u308b\u306e\u3092\u5f85\u6a5f\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc\u306f\u3001 Task \u3067 Operator \u3092\u4f7f\u7528\u3057\u3066<code>ExternalTaskSensor<\/code>\u69cb\u6210\u3067\u304d\u307e\u3059\u3002\u4ee5\u4e0b\u306f\u3001\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc\u3092\u4f7f\u7528\u3057\u305f\u4f8b\u3067\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom airflow.operators.sensors import ExternalTaskSensor\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"Task 1\"',\n    dag=dag,\n)\n\nt2 = ExternalTaskSensor(\n    task_id='task_2',\n    external_dag_id='other_dag',\n    external_task_id='other_task',\n    dag=dag,\n)\n\nt3 = BashOperator(\n    task_id='task_3',\n    bash_command='echo \"Task 3\"',\n    dag=dag,\n)\n\nt1 &gt;&gt; t2 &gt;&gt; t3\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001 Operator<code>task_2<\/code>\u3092\u4f7f\u7528\u3057\u3066in \u306e\u5b9f\u884c\u304c\u5b8c\u4e86\u3057\u305f\u304b\u3069\u3046\u304b<code>ExternalTaskSensor<\/code>\u3092<code>other_dag<\/code>\u76e3\u8996\u3057\u3066\u3044\u307e\u3059\u3002\u5b9f\u884c\u306f\u3001\u5b9f\u884c\u304c<code>other_task<\/code>\u6210\u529f\u3057\u305f\u5834\u5408\u306b\u306e\u307f\u30c8\u30ea\u30ac\u30fc\u3055\u308c\u307e\u3059\u3002<code>other_task<\/code><code>task_2<\/code><\/p>\n\n\n\n<p>Operator\u3067\u306f\u3001\u76e3\u8996\u3059\u308b DAG \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9\u3068\u30bf\u30b9\u30af\u3092<code>ExternalTaskSensor<\/code>\u8a2d\u5b9a<code>external_dag_id<\/code>\u304a\u3088\u3073\u3002<code>external_task_id<\/code>\u3055\u3089\u306b\u3001<code>mode<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc\u306f Airflow \u306e\u975e\u5e38\u306b\u4fbf\u5229\u306a\u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3067\u3042\u308a\u3001\u3088\u308a\u67d4\u8edf\u3067\u8907\u96d1\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u3092\u5b9f\u73fe\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u5909\u6570\u3068\u63a5\u7d9a\u7ba1\u7406 Airflow \u5909\u6570\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u5909\u6570\u3068\u63a5\u7d9a\u306f\u3001\u60c5\u5831\u3092\u7ba1\u7406\u304a\u3088\u3073\u5171\u6709\u3059\u308b\u305f\u3081\u306e 2 \u3064\u306e\u91cd\u8981\u306a\u6982\u5ff5\u3067\u3059\u3002\u5909\u6570\u306f\u3001\u6587\u5b57\u5217\u3001\u6570\u5024\u3001\u30ea\u30b9\u30c8\u3001\u8f9e\u66f8\u306a\u3069\u3001\u3042\u3089\u3086\u308b\u30bf\u30a4\u30d7\u306e\u30c7\u30fc\u30bf\u3092\u683c\u7d0d\u3067\u304d\u307e\u3059\u304c\u3001\u63a5\u7d9a\u306f\u5916\u90e8\u30b7\u30b9\u30c6\u30e0\u3084\u30b5\u30fc\u30d3\u30b9\u3078\u306e\u63a5\u7d9a\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u6c17\u6d41\u5909\u6570<\/h2>\n\n\n\n<p>Airflow \u5909\u6570\u306f\u3001AWS \u30a2\u30af\u30bb\u30b9 \u30ad\u30fc\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u6587\u5b57\u5217\u306a\u3069\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3067\u4f7f\u7528\u3055\u308c\u308b\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u304a\u3088\u3073\u5171\u6709\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002\u5909\u6570\u306f DAG \u3067\u4f7f\u7528\u3067\u304d\u3001Airflow \u30a6\u30a7\u30d6 UI \u304b\u3089\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u6b21\u306e\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u5909\u6570\u3092\u4f5c\u6210\u3001\u8aad\u307f\u53d6\u308a\u3001\u524a\u9664\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5909\u6570\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import models\n\nmodels.Variable.set('my_variable', 'my_value')\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5909\u6570\u306e\u8aad\u307f\u53d6\u308a:<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import models\n\nmy_value = models.Variable.get('my_variable')\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5909\u6570\u3092\u524a\u9664:<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import models\n\nmodels.Variable.delete('my_variable')\n<\/code><\/pre>\n\n\n\n<p>\u5909\u6570\u306f\u3001\u5909\u6570\u306e\u4f5c\u6210\u3001\u7de8\u96c6\u3001\u524a\u9664\u306a\u3069\u3001Airflow Web UI \u306e [\u5909\u6570] \u30da\u30fc\u30b8\u3067\u7ba1\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u30a8\u30a2\u30d5\u30ed\u30fc\u63a5\u7d9a<\/h2>\n\n\n\n<p>Airflow \u63a5\u7d9a\u306f\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3001\u30af\u30e9\u30a6\u30c9 \u30b5\u30fc\u30d3\u30b9\u3001FTP \u30b5\u30fc\u30d0\u30fc\u306a\u3069\u306e\u5916\u90e8\u30b7\u30b9\u30c6\u30e0\u3084\u30b5\u30fc\u30d3\u30b9\u306b\u63a5\u7d9a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002\u63a5\u7d9a\u306f DAG \u3067\u4f7f\u7528\u3067\u304d\u3001Airflow \u30a6\u30a7\u30d6 UI \u304b\u3089\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u6b21\u306e\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u63a5\u7d9a\u3092\u4f5c\u6210\u3001\u8aad\u307f\u53d6\u308a\u3001\u524a\u9664\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u63a5\u7d9a\u3092\u4f5c\u6210\u3057\u307e\u3059:<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import models, settings\nfrom airflow.models import Connection\n\nmy_conn = Connection(\n    conn_id='my_conn',\n    conn_type='my_type',\n    host='my_host',\n    login='my_login',\n    password='my_password',\n    port=1234\n)\n\nsession = settings.Session()\nsession.add(my_conn)\nsession.commit()\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u63a5\u7d9a\u306e\u8aad\u307f\u53d6\u308a:<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import models\n\nmy_conn = models.Connection.get('my_conn')\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u63a5\u7d9a\u3092\u524a\u9664:<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import models\n\nmodels.Connection.delete('my_conn')\n<\/code><\/pre>\n\n\n\n<p>\u63a5\u7d9a\u306f\u3001\u63a5\u7d9a\u306e\u4f5c\u6210\u3001\u7de8\u96c6\u3001\u524a\u9664\u306a\u3069\u3001Airflow Web UI \u306e [\u63a5\u7d9a] \u30da\u30fc\u30b8\u3067\u7ba1\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001Airflow \u5909\u6570\u3068\u63a5\u7d9a\u306f\u3001\u60c5\u5831\u3092\u7ba1\u7406\u304a\u3088\u3073\u5171\u6709\u3059\u308b\u305f\u3081\u306e 2 \u3064\u306e\u91cd\u8981\u306a\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002\u3053\u308c\u3089\u306e\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u5168\u4f53\u3067\u30c7\u30fc\u30bf\u3068\u69cb\u6210\u3092\u4fdd\u5b58\u304a\u3088\u3073\u5171\u6709\u3057\u3001\u3088\u308a\u67d4\u8edf\u3067\u4fdd\u5b88\u3057\u3084\u3059\u3044\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u5909\u6570\u3068\u63a5\u7d9a\u306f DAG \u3067\u5909\u6570\u3092\u4f7f\u7528\u3057\u307e\u3059<\/p>\n\n\n\n<p>Airflow DAG \u3067\u306f\u3001Airflow \u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001\u69cb\u6210\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3001\u8cc7\u683c\u60c5\u5831\u306a\u3069\u306e\u60c5\u5831\u3092\u4fdd\u5b58\u304a\u3088\u3073\u5171\u6709\u3067\u304d\u307e\u3059\u3002\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u3088\u308a\u67d4\u8edf\u3067\u69cb\u6210\u53ef\u80fd\u306a DAG \u3092\u5b9f\u73fe\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u5909\u6570\u3092\u4f7f\u7528\u3057\u305f\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom airflow.models import Variable\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nmy_var = Variable.get('my_variable')\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command=f'echo \"{my_var}\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001<code>Variable.get()<\/code>\u30e1\u30bd\u30c3\u30c9<code>my_variable<\/code>\u540d\u524d\u4ed8\u304d\u5909\u6570\u3092\u53d6\u5f97\u3057\u3001<code>my_var<\/code>\u5909\u6570\u3002\u6b21\u306b\u3001BashOperator \u306e<code>my_var<\/code>\u5909\u6570\u3092\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p><code>Variable.get()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u5909\u6570\u3092\u53d6\u5f97\u3059\u308b\u3060\u3051\u3067\u306a\u304f\u3001DAG \u30d5\u30a1\u30a4\u30eb\u3067\u5909\u6570\u3092\u76f4\u63a5\u5b9a\u7fa9\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002\u5909\u6570\u3092\u5b9a\u7fa9\u3059\u308b\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False,\n    default_args={\n        'my_variable': 'my_value',\n    }\n)\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"{{ dag_run.conf[\"my_variable\"] or dag.default_args[\"my_variable\"] }}\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001DAG \u5b9a\u7fa9\u306e<code>default_args<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf<code>my_variable<\/code>\u3001\u305d\u306e\u30c7\u30d5\u30a9\u30eb\u30c8\u5024\u306f \u306b\u8a2d\u5b9a\u3055\u308c\u3066\u3044\u307e\u3059<code>my_value<\/code>\u3002\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u8a00\u8a9e\u3092\u4f7f\u7528\u3057\u3066\u3001\u30e9\u30f3\u30bf\u30a4\u30e0\u69cb\u6210\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068BashOperator<code>{{ }}<\/code>\u3067\u5b9a\u7fa9\u3055\u308c\u305f\u30c7\u30d5\u30a9\u30eb\u30c8\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306b<code>dag_run.conf<\/code>\u30a2\u30af\u30bb\u30b9\u3057\u307e\u3059\u3002<code>default_args<\/code><\/p>\n\n\n\n<p>\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u3060\u3051\u3067\u306a\u304f\u3001DAG \u3067\u63a5\u7d9a\u3092\u4f7f\u7528\u3057\u3066\u5916\u90e8\u30b7\u30b9\u30c6\u30e0\u3084\u30b5\u30fc\u30d3\u30b9\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002\u63a5\u7d9a\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001DAG \u5185\u306e\u8cc7\u683c\u60c5\u5831\u3068\u69cb\u6210\u60c5\u5831\u3092\u7ba1\u7406\u3057\u305f\u308a\u3001\u5b9f\u884c\u6642\u306b\u5916\u90e8\u30b7\u30b9\u30c6\u30e0\u3084\u30b5\u30fc\u30d3\u30b9\u306b\u63a5\u7d9a\u3057\u305f\u308a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>DAG \u3067\u63a5\u7d9a\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001<code>Connection.get()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u3002\u7d50\u5408\u3092\u4f7f\u7528\u3057\u305f\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.mysql_operator import MySqlOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nmy_conn = Connection.get('my_conn')\n\nt1 = MySqlOperator(\n    task_id='task_1',\n    sql='SELECT * FROM my_table',\n    mysql_conn_id=my_conn.conn_id,\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001<code>Connection.get()<\/code>\u30e1\u30bd\u30c3\u30c9<code>my_conn<\/code>\u3068\u3044\u3046\u540d\u524d\u306e\u63a5\u7d9a\u60c5\u5831\u3092\u53d6\u5f97\u3057\u3001\u305d\u308c<code>MySqlOperator<\/code>\u3092<code>mysql_conn_id<\/code>\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u306b\u6e21\u3057\u307e\u3059\u3002\u3053\u306e\u3088\u3046\u306b\u3057\u3066\u3001\u63a5\u7d9a\u60c5\u5831\u3092 Operator \u3067\u4f7f\u7528\u3057\u3066 MySQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001Airflow \u5909\u6570\u3068\u63a5\u7d9a\u306f\u4fdd\u5b58\u3068\u5171\u6709\u306b\u5f79\u7acb\u3061\u307e\u3059<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u63a5\u7d9a\u7ba1\u7406\u3068\u63a5\u7d9a\u306e\u4f7f\u7528\u306b\u3064\u3044\u3066\u3001Airflow \u5909\u6570\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3001\u30af\u30e9\u30a6\u30c9 \u30b5\u30fc\u30d3\u30b9\u3001FTP \u30b5\u30fc\u30d0\u30fc\u306a\u3069\u306e\u5916\u90e8\u30b7\u30b9\u30c6\u30e0\u3084\u30b5\u30fc\u30d3\u30b9\u306b\u63a5\u7d9a\u3059\u308b\u305f\u3081\u306b\u63a5\u7d9a\u304c\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002\u63a5\u7d9a\u306f DAG \u3067\u4f7f\u7528\u3067\u304d\u3001Airflow \u30a6\u30a7\u30d6 UI \u304b\u3089\u69cb\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u6b21\u306e\u65b9\u6cd5\u3092\u4f7f\u7528\u3057\u3066\u63a5\u7d9a\u3092\u7ba1\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u63a5\u7d9a\u306e\u4f5c\u6210: Airflow Web UI \u306e [\u63a5\u7d9a] \u30da\u30fc\u30b8\u3067\u3001[\u4f5c\u6210] \u30dc\u30bf\u30f3\u3092\u30af\u30ea\u30c3\u30af\u3057\u3066\u65b0\u3057\u3044\u63a5\u7d9a\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u63a5\u7d9a\u3092\u4f5c\u6210\u3059\u308b\u3068\u304d\u306f\u3001\u63a5\u7d9a ID\u3001\u30bf\u30a4\u30d7\u3001\u30db\u30b9\u30c8\u540d\u3001\u30e6\u30fc\u30b6\u30fc\u540d\u3001\u30d1\u30b9\u30ef\u30fc\u30c9\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u60c5\u5831\u3092\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u63a5\u7d9a\u306e\u7de8\u96c6: Airflow Web UI \u306e [\u63a5\u7d9a] \u30da\u30fc\u30b8\u3067\u3001\u63a5\u7d9a\u540d\u3092\u30af\u30ea\u30c3\u30af\u3057\u3066\u63a5\u7d9a\u306e\u8a73\u7d30\u30da\u30fc\u30b8\u306b\u5165\u308a\u307e\u3059\u3002\u3053\u306e\u30da\u30fc\u30b8\u3067\u306f\u3001\u30db\u30b9\u30c8\u540d\u3001\u30e6\u30fc\u30b6\u30fc\u540d\u3001\u30d1\u30b9\u30ef\u30fc\u30c9\u306a\u3069\u306e\u63a5\u7d9a\u306e\u30d7\u30ed\u30d1\u30c6\u30a3\u3092\u7de8\u96c6\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u63a5\u7d9a\u306e\u524a\u9664: Airflow Web UI \u306e [\u63a5\u7d9a] \u30da\u30fc\u30b8\u3067\u3001\u63a5\u7d9a\u540d\u3092\u30af\u30ea\u30c3\u30af\u3057\u3066\u63a5\u7d9a\u306e\u8a73\u7d30\u30da\u30fc\u30b8\u306b\u5165\u308a\u307e\u3059\u3002\u3053\u306e\u30da\u30fc\u30b8\u3067\u3001[\u524a\u9664] \u30dc\u30bf\u30f3\u3092\u30af\u30ea\u30c3\u30af\u3057\u3066\u63a5\u7d9a\u3092\u524a\u9664\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>DAG \u3067\u63a5\u7d9a\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001<code>Connection.get()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u3002\u7d50\u5408\u3092\u4f7f\u7528\u3057\u305f\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.mysql_operator import MySqlOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nmy_conn = Connection.get('my_conn')\n\nt1 = MySqlOperator(\n    task_id='task_1',\n    sql='SELECT * FROM my_table',\n    mysql_conn_id=my_conn.conn_id,\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001<code>Connection.get()<\/code>\u30e1\u30bd\u30c3\u30c9<code>my_conn<\/code>\u3068\u3044\u3046\u540d\u524d\u306e\u63a5\u7d9a\u60c5\u5831\u3092\u53d6\u5f97\u3057\u3001\u305d\u308c<code>MySqlOperator<\/code>\u3092<code>mysql_conn_id<\/code>\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u306b\u6e21\u3057\u307e\u3059\u3002\u3053\u306e\u3088\u3046\u306b\u3057\u3066\u3001\u63a5\u7d9a\u60c5\u5831\u3092 Operator \u3067\u4f7f\u7528\u3057\u3066 MySQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u63a5\u7d9a\u3092\u4f7f\u7528\u3059\u308b\u3060\u3051\u3067\u306a\u304f\u3001DAG \u3067\u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001\u69cb\u6210\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3001\u8cc7\u683c\u60c5\u5831\u306a\u3069\u306e\u60c5\u5831\u3092\u4fdd\u5b58\u304a\u3088\u3073\u5171\u6709\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u3088\u308a\u67d4\u8edf\u3067\u69cb\u6210\u53ef\u80fd\u306a DAG \u3092\u5b9f\u73fe\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n\n\n\n<p>DAG \u3067\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001<code>Variable.get()<\/code>\u30e1\u30bd\u30c3\u30c9\u5909\u6570\u60c5\u5831\u3092\u53d6\u5f97\u3057\u3001\u305d\u306e\u5909\u6570\u60c5\u5831\u3092 Operator \u3067\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u5909\u6570\u306e\u4f7f\u7528\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom airflow.models import Variable\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nmy_var = Variable.get('my_variable')\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command=f'echo \"{my_var}\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001<code>Variable.get()<\/code>\u30e1\u30bd\u30c3\u30c9<code>my_variable<\/code>\u540d\u524d\u4ed8\u304d\u5909\u6570\u3092\u53d6\u5f97\u3057\u3001<code>my_var<\/code>\u5909\u6570\u3002\u6b21\u306b\u3001BashOperator \u306e<code>my_var<\/code>\u5909\u6570\u3092\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001Airflow \u63a5\u7d9a\u3068\u5909\u6570\u306f\u3001\u69cb\u6210\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3001\u8cc7\u683c\u60c5\u5831\u306a\u3069\u306e\u60c5\u5831\u3092 DAG \u306b\u4fdd\u5b58\u3057\u3066\u5171\u6709\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u63a5\u7d9a\u3068\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u3088\u308a\u67d4\u8edf\u3067\u69cb\u6210\u53ef\u80fd\u306a DAG \u3092\u6709\u52b9\u306b\u3057\u3001\u6a5f\u5bc6\u60c5\u5831\u306e\u7ba1\u7406\u3068\u4fdd\u8b77\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow XComs (Cross Task Communication) XCom \u306e\u7d39\u4ecb\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001XCom (Cross Communication) \u306f\u30bf\u30b9\u30af\u9593\u3067\u30c7\u30fc\u30bf\u3092\u6e21\u3059\u305f\u3081\u306e\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002XCom \u3092\u4ecb\u3057\u3066\u3001\u30bf\u30b9\u30af\u306f\u4ed6\u306e\u30bf\u30b9\u30af\u306b\u30c7\u30fc\u30bf\u3092\u9001\u4fe1\u3057\u305f\u308a\u3001\u4ed6\u306e\u30bf\u30b9\u30af\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53d7\u4fe1\u3057\u305f\u308a\u3057\u3066\u3001\u3088\u308a\u67d4\u8edf\u3067\u8907\u96d1\u306a\u30bf\u30b9\u30af \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u3068\u30c7\u30fc\u30bf\u51e6\u7406\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>XCom \u30e1\u30ab\u30cb\u30ba\u30e0\u306f\u3001\u6b21\u306e\u6a5f\u80fd\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af\u9593\u3067\u30c7\u30fc\u30bf\u3092\u5171\u6709\u3059\u308b<\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf\u306e\u4fdd\u5b58\u3068\u53d6\u5f97<\/li>\n\n\n\n<li>Key\u5024\u306b\u3088\u308b\u30c7\u30fc\u30bf\u53d6\u5f97<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u9593\u306e\u8ee2\u9001\u30c7\u30fc\u30bf\u578b\u3092\u4efb\u610f\u306e Python \u30c7\u30fc\u30bf\u578b\u3068\u3057\u3066\u30b5\u30dd\u30fc\u30c8<\/li>\n<\/ul>\n\n\n\n<p>Airflow \u3067\u306f\u3001XCom \u30c7\u30fc\u30bf\u306f Airflow \u30e1\u30bf\u30d9\u30fc\u30b9\u306b\u4fdd\u5b58\u3055\u308c\u307e\u3059\u3002\u4ee5\u4e0b\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u9593\u3067\u30c7\u30fc\u30bf\u3092\u6e21\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30c7\u30fc\u30bf\u306e\u9001\u4fe1: \u30bf\u30b9\u30af\u3067<code>context<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u30c7\u30fc\u30bf\u3092\u9001\u4fe1\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30bf\u30b9\u30af\u3067<code>context['task_instance'].xcom_push(key='my_key', value='my_value')<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u3002<\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf\u306e\u53d7\u4fe1: \u30bf\u30b9\u30af\u5185\u306e<code>context<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u30c7\u30fc\u30bf\u3092\u53d7\u4fe1\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30bf\u30b9\u30af\u3067<code>my_value = context['task_instance'].xcom_pull(key='my_key')<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u3002<\/li>\n<\/ul>\n\n\n\n<p>DAG \u3067 XCom \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001<code>xcom_push()<\/code>\u30e1\u30bd\u30c3\u30c9XCom \u30b9\u30c8\u30a2\u306b\u30c7\u30fc\u30bf\u3092\u9001\u4fe1\u3057\u3001<code>xcom_pull()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066 XCom \u30b9\u30c8\u30a2\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3067\u304d\u307e\u3059\u3002XCom \u3092\u4f7f\u7528\u3057\u305f\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"Hello, Airflow!\"',\n    dag=dag,\n)\n\nt2 = BashOperator(\n    task_id='task_2',\n    bash_command='echo \"{{ ti.xcom_pull(task_ids=\"task_1\") }}\"',\n    dag=dag,\n)\n\nt1 &gt;&gt; t2\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u30bf\u30b9\u30af\u306f\u30b3\u30de\u30f3\u30c9<code>t1<\/code>\u3092\u5b9f\u884c\u3057<code>\"echo \"Hello, Airflow!\"<\/code>\u3001\u6587\u5b57\u5217\u3092 XCom \u30b9\u30c8\u30a2\u306b<code>\"Hello, Airflow!\"<\/code>\u683c\u7d0d\u3057\u307e\u3059\u3002\u3053\u306e\u30bf\u30b9\u30af\u306f<code>t2<\/code>\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u8a00\u8a9e<code>{{ }}<\/code>\u3068<code>ti.xcom_pull()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066<code>\"echo \"{{ ti.xcom_pull(task_ids=\"task_1\") }}\"<\/code>\u3001\u30b3\u30de\u30f3\u30c9\u3078\u306e\u5f15\u6570\u3068\u3057\u3066 XCom \u30b9\u30c8\u30a2\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001XCom \u306f Airflow \u3067\u30bf\u30b9\u30af\u9593\u3067\u30c7\u30fc\u30bf\u3092\u6e21\u3059\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002XCom \u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u30bf\u30b9\u30af\u9593\u3067\u30c7\u30fc\u30bf\u3092\u5171\u6709\u3057\u305f\u308a\u3001\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u304a\u3088\u3073\u53d6\u5f97\u3057\u305f\u308a\u3001\u4efb\u610f\u306e Python \u30c7\u30fc\u30bf\u578b\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u305f\u308a\u3067\u304d\u307e\u3059\u3002DAG \u3067 XCom \u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u3088\u308a\u67d4\u8edf\u3067\u8907\u96d1\u306a\u30bf\u30b9\u30af \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u3068\u30c7\u30fc\u30bf\u51e6\u7406\u304c\u53ef\u80fd\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u304c\u30bf\u30b9\u30af\u3067 XCom \u3092\u751f\u6210\u304a\u3088\u3073\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u306f\u5b9f\u884c\u6642\u306b XComs (\u30af\u30ed\u30b9\u30bf\u30b9\u30af\u901a\u4fe1) \u3092\u751f\u6210\u3057\u3066\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002XComs \u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001\u30bf\u30b9\u30af\u306f\u5b9f\u884c\u4e2d\u306b\u30c7\u30fc\u30bf\u3092\u5171\u6709\u3067\u304d\u308b\u305f\u3081\u3001\u3088\u308a\u67d4\u8edf\u3067\u8907\u96d1\u306a\u30bf\u30b9\u30af \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u3068\u30c7\u30fc\u30bf\u51e6\u7406\u304c\u53ef\u80fd\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u30bf\u30b9\u30af\u3067 XCom \u3092\u751f\u6210\u3059\u308b\u65b9\u6cd5\u306f\u3001\u30c7\u30fc\u30bf\u3092 XCom \u30b9\u30c8\u30a2\u306b\u683c\u7d0d\u3059\u308b<code>task_instance.xcom_push()<\/code>\u30e1\u30bd\u30c3\u30c9\u3002\u30e1\u30bd\u30c3\u30c9\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306b<code>key<\/code>\u306f<code>value<\/code>\u3001<code>key<\/code>XCom \u30b9\u30c8\u30ec\u30fc\u30b8\u5185\u306e\u30c7\u30fc\u30bf\u3092\u8b58\u5225\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3055\u308c\u308b\u6587\u5b57\u5217\u3067\u3042\u308b \u3068 \u304c\u542b\u307e\u308c\u3066\u304a\u308a\u3001<code>value<\/code>\u3053\u308c\u304c\u683c\u7d0d\u3055\u308c\u308b\u30c7\u30fc\u30bf\u3067\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u6b21\u306e\u30b3\u30fc\u30c9\u306f\u3001\u30bf\u30b9\u30af\u3067 XCom \u3092\u751f\u6210\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>def my_task(ds, **kwargs):\n    # \u4ea7\u751f XCom \u6570\u636e\n    task_instance = kwargs['task_instance']\n    task_instance.xcom_push(key='my_key', value='my_value')\n<\/code><\/pre>\n\n\n\n<p>\u30bf\u30b9\u30af\u3067 XComs \u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u306f\u3001XCom \u30b9\u30c8\u30a2\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3059\u308b<code>task_instance.xcom_pull()<\/code>\u30e1\u30bd\u30c3\u30c9\u3002\u30e1\u30bd\u30c3\u30c9\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc<code>key<\/code>\u306b<code>task_ids<\/code>\u3001<code>key<\/code>\u53d6\u5f97\u3059\u308b\u30c7\u30fc\u30bf\u306e\u30ad\u30fc\u5024\u3067\u3042\u308a\u3001<code>task_ids<\/code>\u53d6\u5f97\u3059\u308b\u30bf\u30b9\u30af\u306e ID \u3092\u793a\u3059\u6587\u5b57\u5217\u307e\u305f\u306f\u6587\u5b57\u5217\u306e\u30ea\u30b9\u30c8\u3067\u3042\u308b\u30aa\u30d7\u30b7\u30e7\u30f3\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc \u304c\u542b\u307e\u308c\u307e\u3059\u3002\u6307\u5b9a\u3057\u306a\u3044\u5834\u5408<code>task_ids<\/code>\u3001\u30c7\u30d5\u30a9\u30eb\u30c8\u3067\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306b\u306a\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u6b21\u306e\u30b3\u30fc\u30c9\u306f\u3001\u30bf\u30b9\u30af\u3067 XCom \u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>def my_task(ds, **kwargs):\n    # \u68c0\u7d22 XCom \u6570\u636e\n    task_instance = kwargs['task_instance']\n    my_value = task_instance.xcom_pull(key='my_key')\n    print(my_value)\n<\/code><\/pre>\n\n\n\n<p>DAG \u3067\u306f\u3001\u30bf\u30b9\u30af\u3092\u9023\u9396\u3055\u305b\u308b\u3053\u3068\u3067 XCom \u3092\u6e21\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u6b21\u306e\u30b3\u30fc\u30c9\u306f\u3001XCom \u3092\u4f7f\u7528\u3057\u3066 2 \u3064\u306e\u30bf\u30b9\u30af\u9593\u3067\u30c7\u30fc\u30bf\u3092\u6e21\u3059\u65b9\u6cd5\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"Hello, Airflow!\"',\n    dag=dag,\n)\n\nt2 = BashOperator(\n    task_id='task_2',\n    bash_command='echo \"{{ ti.xcom_pull(task_ids=\"task_1\") }}\"',\n    dag=dag,\n)\n\nt1 &gt;&gt; t2\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u30bf\u30b9\u30af\u306f\u30b3\u30de\u30f3\u30c9<code>t1<\/code>\u3092\u5b9f\u884c\u3057<code>\"echo \"Hello, Airflow!\"<\/code>\u3001\u6587\u5b57\u5217\u3092 XCom \u30b9\u30c8\u30a2\u306b<code>\"Hello, Airflow!\"<\/code>\u683c\u7d0d\u3057\u307e\u3059\u3002\u3053\u306e\u30bf\u30b9\u30af\u306f<code>t2<\/code>\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u8a00\u8a9e<code>{{ }}<\/code>\u3068<code>ti.xcom_pull()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066<code>\"echo \"{{ ti.xcom_pull(task_ids=\"task_1\") }}\"<\/code>\u3001\u30b3\u30de\u30f3\u30c9\u3078\u306e\u5f15\u6570\u3068\u3057\u3066 XCom \u30b9\u30c8\u30a2\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3057\u307e\u3059\u3002\u30bf\u30b9\u30af \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u3067\u306f\u3001<code>&gt;&gt;<\/code>\u6f14\u7b97\u5b50\u30bf\u30b9\u30af\u3092\u30ea\u30f3\u30af\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001Airflow \u306e\u30bf\u30b9\u30af\u306f XCom \u3092\u751f\u6210\u3057\u3066\u4f7f\u7528\u3057\u3001\u5b9f\u884c\u4e2d\u306b\u30c7\u30fc\u30bf\u3092\u5171\u6709\u3067\u304d\u307e\u3059\u3002XComs \u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u3088\u308a\u67d4\u8edf\u3067\u8907\u96d1\u306a\u30bf\u30b9\u30af \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u3068\u30c7\u30fc\u30bf\u51e6\u7406\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002\u30bf\u30b9\u30af\u3067\u306f\u3001<code>task_instance.xcom_push()<\/code>\u30e1\u30bd\u30c3\u30c9\u3092<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>task_instance.xcom_pull()` \u30e1\u30bd\u30c3\u30c9\u306f\u3001XCom \u30b9\u30c8\u30a2\u304b\u3089 XCom \u3092\u53d6\u5f97\u3057\u307e\u3059\u3002DAG \u3067\u306f\u3001\u30bf\u30b9\u30af\u3092\u9023\u9396\u3055\u305b\u308b\u3053\u3068\u3067 XCom \u3092\u6e21\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068 Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u304c\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u52d5\u7684\u306b\u751f\u6210\u3059\u308b\u65b9\u6cd5\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306f\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u52d5\u7684\u306b\u751f\u6210\u3067\u304d\u308b\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306b\u306f\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u4e2d\u306b\u5fc5\u8981\u306b\u5fdc\u3058\u3066\u7f6e\u63db\u3067\u304d\u308b\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3092\u542b\u3081\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002Airflow \u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u3092\u4f7f\u7528\u3057\u3066\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u51e6\u7406\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>Jinja \u306f Python \u7528\u306e\u4eba\u6c17\u306e\u3042\u308b\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u3067\u3001\u8ad6\u7406\u5236\u5fa1\u3001\u5909\u6570\u3001\u30d5\u30a3\u30eb\u30bf\u30fc\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u6a5f\u80fd\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u308b\u305f\u3081\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3057\u3066\u3055\u307e\u3056\u307e\u306a\u30c6\u30ad\u30b9\u30c8\u5f62\u5f0f\u3092\u3059\u3070\u3084\u304f\u751f\u6210\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u540d\u3001Bash \u30b3\u30de\u30f3\u30c9\u3001SQL \u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u51e6\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306f\u3001\u4e8c\u91cd\u4e2d\u62ec\u5f27\u3092\u4f7f\u7528\u3057\u3066\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570<code>{{ }}<\/code>\u3092\u8b58\u5225\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u6b21\u306e\u30b3\u30fc\u30c9\u306f\u3001BashOperator \u3067\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, 1),\n    catchup=False\n)\n\nmy_var = 'Airflow'\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"Hello, {{ var.value.my_var }}!\"',\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u6587\u5b57\u5217<code>my_var<\/code>\u304c\u5b9a\u7fa9\u3055\u308c<code>'Airflow'<\/code>\u3001\u30bf\u30b9\u30af<code>t1<\/code>\u306e<code>{{ var.value.my_var }}<\/code>\u3002Airflow \u306e<code>var.value<\/code>\u5909\u6570\u306fAirflow \u306e\u5909\u6570\u3092\u8868\u3057\u3001<code>var.value<\/code>\u5909\u6570\u540d\u3092\u4f7f\u7528\u3057\u3066\u5909\u6570\u306e\u5024\u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u3059\u3002\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u4e2d\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306f\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3092\u6587\u5b57\u5217\u306b<code>{{ var.value.my_var }}<\/code>\u7f6e\u304d\u63db\u3048\u3066<code>'Airflow'<\/code>\u3001\u6700\u7d42\u7684\u306a Bash \u30b3\u30de\u30f3\u30c9\u3092\u751f\u6210\u3057\u307e\u3059<code>\"echo \"Hello, Airflow!\"<\/code>\u3002<\/p>\n\n\n\n<p><code>var.value<\/code>\u5909\u6570\u306b\u52a0\u3048\u3066\u3001Airflow \u306b\u306f\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3067\u4f7f\u7528\u3067\u304d\u308b\u4ed6\u306e\u30b0\u30ed\u30fc\u30d0\u30eb\u5909\u6570\u3082\u3044\u304f\u3064\u304b\u7528\u610f\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>ds<\/code>: \u306e\u5f62\u5f0f\u306e\u73fe\u5728\u306e\u5b9f\u884c\u65e5<code>YYYY-MM-DD<\/code>\u3002<\/li>\n\n\n\n<li><code>ds_nodash<\/code>: \u306e\u5f62\u5f0f\u306e\u73fe\u5728\u306e\u5b9f\u884c\u65e5<code>YYYYMMDD<\/code>\u3002<\/li>\n\n\n\n<li><code>ts<\/code>: \u306e\u5f62\u5f0f\u3067\u306e\u73fe\u5728\u306e\u5b9f\u884c\u6642\u9593<code>YYYY-MM-DDTHH:mm:ss<\/code>\u3002<\/li>\n\n\n\n<li><code>ts_nodash<\/code>: \u306e\u5f62\u5f0f\u3067\u306e\u73fe\u5728\u306e\u5b9f\u884c\u6642\u9593<code>YYYYMMDDTHHmmss<\/code>\u3002<\/li>\n\n\n\n<li><code>yesterday_ds<\/code>: \u5f62\u5f0f\u306e\u6628\u65e5\u306e\u65e5\u4ed8<code>YYYY-MM-DD<\/code>\u3002<\/li>\n\n\n\n<li><code>yesterday_ds_nodash<\/code>: \u5f62\u5f0f\u306e\u6628\u65e5\u306e\u65e5\u4ed8<code>YYYYMMDD<\/code>\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001\u6761\u4ef6\u6587\u3001\u30eb\u30fc\u30d7\u6587\u3001\u6587\u5b57\u5217\u51e6\u7406\u306a\u3069\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u304c\u30b5\u30dd\u30fc\u30c8\u3059\u308b\u3055\u307e\u3056\u307e\u306a\u30ed\u30b8\u30c3\u30af\u5236\u5fa1\u304a\u3088\u3073\u30d5\u30a3\u30eb\u30bf\u6a5f\u80fd\u3082\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u6b21\u306e\u30b3\u30fc\u30c9\u306f\u3001\u6761\u4ef6\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u3068\u6587\u5b57\u5217\u30d5\u30a3\u30eb\u30bf\u30fc\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u540d\u3092\u751f\u6210\u3059\u308b\u65b9\u6cd5\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom datetime import datetime\n\ndag = DAG(\n    'my_dag',\n    schedule_interval='0 0 * * *',\n    start_date=datetime(2023, 1, \n<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>1)\u3001\u30ad\u30e3\u30c3\u30c1\u30a2\u30c3\u30d7 = False )<\/p>\n\n\n\n<p>my_var = &#8216;Airflow&#8217; my_list = [&#8216;apple&#8217;, &#8216;banana&#8217;, &#8216;orange&#8217;]<\/p>\n\n\n\n<p>for fruit in my_list: t = BashOperator( task_id=&#8217;task_&#8217; + fruit, bash_command=&#8217;echo \u201c\u3053\u3093\u306b\u3061\u306f\u3001{{ var.value.my_var }}! \u3053\u308c\u306f {{ fruit|capitalize }} \u3067\u3059\u3002\u201d&#8217;, dag=dag \u3001 )<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">go\u30b3\u30d4\u30fc\u30b3\u30fc\u30c9<code>\n\u5728\u4e0a\u8ff0\u4f8b\u5b50\u4e2d\uff0c\u4f7f\u7528\u53d8\u91cf `my_var` \u5b9a\u4e49\u4e86\u4e00\u4e2a\u5b57\u7b26\u4e32 `'Airflow'`\uff0c\u4f7f\u7528\u5217\u8868 `my_list` \u5b9a\u4e49\u4e86\u4e00\u4e2a\u5305\u542b\u4e09\u4e2a\u5b57\u7b26\u4e32\u7684\u5217\u8868\u3002\u7136\u540e\uff0c\u4f7f\u7528\u5faa\u73af\u8bed\u53e5 `for` \u5728 DAG \u4e2d\u751f\u6210\u4e09\u4e2a BashOperator \u4efb\u52a1\uff0c\u4efb\u52a1\u540d\u79f0\u6839\u636e\u5faa\u73af\u53d8\u91cf `fruit` \u52a8\u6001\u751f\u6210\u3002\u5728\u4efb\u52a1 `t` \u7684 Bash \u547d\u4ee4\u4e2d\u4f7f\u7528\u4e86\u6a21\u677f\u53d8\u91cf `{{ var.value.my_var }}` \u548c\u5b57\u7b26\u4e32\u8fc7\u6ee4\u5668 `{{ fruit|capitalize }}`\uff0c\u751f\u6210\u6700\u7ec8\u7684 Bash \u547d\u4ee4\uff0c\u4f8b\u5982 `\"echo \"Hello, Airflow! This is Apple.\"`\u3002\n\n\u603b\u4e4b\uff0c\u5728 Airflow \u4e2d\uff0c\u6a21\u677f\u662f\u4e00\u79cd\u53ef\u4ee5\u52a8\u6001\u751f\u6210\u4efb\u52a1\u53c2\u6570\u7684\u673a\u5236\u3002\u6a21\u677f\u53ef\u4ee5\u5305\u542b\u6a21\u677f\u53d8\u91cf\uff0c\u6a21\u677f\u53d8\u91cf\u53ef\u4ee5\u5728\u4efb\u52a1\u6267\u884c\u65f6\u6839\u636e\u9700\u8981\u8fdb\u884c\u66ff\u6362\u3002Airflow \u4f7f\u7528 Jinja \u6a21\u677f\u5f15\u64ce\u6765\u5904\u7406\u6a21\u677f\u3002Jinja \u6a21\u677f\u4f7f\u7528\u53cc\u5927\u62ec\u53f7 `{{ }}` \u6765\u6807\u8bc6\u6a21\u677f\u53d8\u91cf\uff0c\u8fd8\u652f\u6301\u5404\u79cd\u903b\u8f91\u63a7\u5236\u548c\u8fc7\u6ee4\u5668\u529f\u80fd\u3002\u53ef\u4ee5\u4f7f\u7528\u6a21\u677f\u5feb\u901f\u751f\u6210\u5404\u79cd\u6587\u672c\u683c\u5f0f\u7684\u4efb\u52a1\u53c2\u6570\uff0c\u4ece\u800c\u5b9e\u73b0\u66f4\u7075\u6d3b\u3001\u66f4\u590d\u6742\u7684\u4efb\u52a1\u7f16\u6392\u548c\u6570\u636e\u5904\u7406\u3002\n<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067\u4f7f\u7528\u3059\u308b Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u52d5\u7684\u306b\u751f\u6210\u3067\u304d\u307e\u3059\u3002\u30bf\u30b9\u30af\u540d\u3001Bash \u30b3\u30de\u30f3\u30c9\u3001SQL \u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3057\u3066\u7c21\u5358\u306b\u51e6\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067\u306f\u3001\u5909\u6570\u3001\u30ed\u30b8\u30c3\u30af \u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u3001\u30d5\u30a3\u30eb\u30bf\u30fc\u306a\u3069\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306e\u3055\u307e\u3056\u307e\u306a\u6a5f\u80fd\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u52d5\u7684\u306b\u751f\u6210\u3067\u304d\u307e\u3059\u3002Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306f\u3001\u4e8c\u91cd\u4e2d\u304b\u3063\u3053\u3092\u4f7f\u7528\u3057\u3066\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570<code>{{ }}<\/code>\u3092\u8b58\u5225\u3057\u3001<code>{% %}<\/code>\u8ad6\u7406\u5236\u5fa1\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u3092\u8b58\u5225\u3057\u3001Airflow \u306e JSON \u578b\u5909\u6570\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b<code>{{ var.json.* }}<\/code>\u305f\u3081\u306b\u3002\u4e00\u822c\u7684\u306a Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306e\u69cb\u6587\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570: \u5909\u6570\u3092<code>{{ variable }}<\/code>\u8b58\u5225\u3059\u308b\u3002\u3053\u306e\u5909\u6570\u306f\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u306b\u5909\u6570\u306e\u5024\u306b\u52d5\u7684\u306b\u7f6e\u304d\u63db\u3048\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u4f8b: pythonCopy \u30b3\u30fc\u30c9<code>from airflow import DAG from airflow.operators.bash_operator import BashOperator from datetime import datetime dag = DAG( 'my_dag', schedule_interval='0 0 * * *', start_date=datetime(2023, 1, 1), catchup=False ) my_var = 'Airflow' t1 = BashOperator( task_id='task_1', bash_command='echo \"Hello, {{ my_var }}!\"', dag=dag, )&nbsp;<\/code>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u6587\u5b57\u5217<code>my_var<\/code>\u3092\u5b9a\u7fa9\u3057<code>'Airflow'<\/code>\u3001\u30bf\u30b9\u30af<code>t1<\/code>\u306e<code>{{ my_var }}<\/code>\u3002\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u4e2d\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306f\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3092\u6587\u5b57\u5217\u306b<code>{{ my_var }}<\/code>\u7f6e\u304d\u63db\u3048\u3066<code>'Airflow'<\/code>\u3001\u6700\u7d42\u7684\u306a Bash \u30b3\u30de\u30f3\u30c9\u3092\u751f\u6210\u3057\u307e\u3059<code>\"echo \"Hello, Airflow!\"<\/code>\u3002<\/li>\n\n\n\n<li>\u8ad6\u7406\u5236\u5fa1\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8:<code>{% if condition %}<\/code>\u304a\u3088\u3073<code>{% endif %}<\/code>\u3001\u6761\u4ef6\u306b\u5f93\u3063\u3066\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u751f\u6210\u3059\u308b\u304b\u3069\u3046\u304b\u3092\u6c7a\u5b9a\u3067\u304d\u308b\u6761\u4ef6\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u3092\u8b58\u5225\u3057\u307e\u3059\u3002\u4f8b: pythonCopy \u30b3\u30fc\u30c9<code>from airflow import DAG from airflow.operators.bash_operator import BashOperator from datetime import datetime dag = DAG( 'my_dag', schedule_interval='0 0 * * *', start_date=datetime(2023, 1, 1), catchup=False ) my_var = 'Airflow' my_condition = True t1 = BashOperator( task_id='task_1', bash_command='{% if my_condition %}echo \"Hello, {{ my_var }}!\"{% endif %}', dag=dag, )&nbsp;<\/code>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u6587\u5b57\u5217<code>my_var<\/code>\u306f variable \u3092\u4f7f\u7528\u3057\u3066\u5b9a\u7fa9\u3055\u308c<code>'Airflow'<\/code>\u3001\u30d6\u30fc\u30eb\u5909\u6570\u306f variable \u3092\u4f7f\u7528\u3057\u3066<code>my_condition<\/code>\u5b9a\u7fa9\u3055\u308c\u307e\u3059<code>True<\/code>\u3002\u6b21\u306b<code>t1<\/code>\u3001\u30bf\u30b9\u30af\u306e Bash \u30b3\u30de\u30f3\u30c9\u3067\u6761\u4ef6\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8<code>{% if my_condition %}<\/code>\u3068<code>{% endif %}<\/code>\u5909\u6570\u304c true<code>my_condition<\/code>\u304b\u3069\u3046\u304b\u3092\u4f7f\u7528\u3055\u308c\u307e\u3059\u3002variable<code>my_condition<\/code>\u304c\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3092\u4f7f\u7528\u3057\u3066<code>{{ my_var }}<\/code>Bash \u3092\u751f\u6210\u3057\u307e\u3059<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>command&nbsp;<code>\"echo \"Hello, Airflow!\"<\/code>\u3001\u305d\u308c\u4ee5\u5916\u306e\u5834\u5408\u3001\u30b3\u30de\u30f3\u30c9\u306f\u751f\u6210\u3055\u308c\u307e\u305b\u3093\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30d5\u30a3\u30eb\u30bf\u30fc:<code>{{ variable | filter }}<\/code>\u5f62\u5f0f\u3001\u5927\u6587\u5b57\u3068\u5c0f\u6587\u5b57\u306e\u5909\u63db\u3001\u65e5\u4ed8\u306e\u66f8\u5f0f\u8a2d\u5b9a\u306a\u3069\u3001\u5909\u6570\u3092\u30d5\u30a3\u30eb\u30bf\u30fc\u51e6\u7406\u3057\u307e\u3059\u3002\u4f8b: pythonCopy \u30b3\u30fc\u30c9<code>from airflow import DAG from airflow.operators.bash_operator import BashOperator from datetime import datetime dag = DAG( 'my_dag', schedule_interval='0 0 * * *', start_date=datetime(2023, 1, 1), catchup=False ) my_var = 'Airflow' t1 = BashOperator( task_id='task_1', bash_command='echo \"Hello, {{ my_var|upper }}!\"', dag=dag, )&nbsp;<\/code>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u5909\u6570 \u3092\u4f7f\u7528\u3057\u3066\u6587\u5b57\u5217<code>my_var<\/code>\u3092\u5b9a\u7fa9\u3057<code>'Airflow'<\/code>\u3001\u30bf\u30b9\u30af<code>t1<\/code>\u306e<code>|upper<\/code>\u6587\u5b57\u5217\u3092\u5927\u6587\u5b57\u306b\u5909\u63db\u3057\u307e\u3059\u3002\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u4e2d\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306f\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3092\u6587\u5b57\u5217\u306b<code>{{ my_var|upper }}<\/code>\u7f6e\u304d\u63db\u3048\u3066<code>'AIRFLOW'<\/code>\u3001\u6700\u7d42\u7684\u306a Bash \u30b3\u30de\u30f3\u30c9\u3092\u751f\u6210\u3057\u307e\u3059<code>\"echo \"Hello, AIRFLOW!\"<\/code>\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3067\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u7c21\u5358\u304b\u3064\u52d5\u7684\u306b\u751f\u6210\u3057\u3066\u3001\u3088\u308a\u67d4\u8edf\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u914d\u7f6e\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u5909\u6570\u3001\u8ad6\u7406\u5236\u5fa1\u6587\u3001\u30d5\u30a3\u30eb\u30bf\u306a\u3069\u306e\u6a5f\u80fd\u3092\u30bf\u30b9\u30af\u306e\u8981\u6c42\u306b\u5fdc\u3058\u3066\u81ea\u7531\u306b\u7d44\u307f\u5408\u308f\u305b\u3066\u3001\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u751f\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068 Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306e Airflow \u30de\u30af\u30ed\u3068\u6a5f\u80fd\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u306e\u4f7f\u7528\u306b\u52a0\u3048\u3066\u3001Airflow \u306b\u306f\u3001DAG \u3067\u52d5\u7684\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u751f\u6210\u3059\u308b\u305f\u3081\u306e\u591a\u6570\u306e\u7d44\u307f\u8fbc\u307f\u30de\u30af\u30ed\u3068\u95a2\u6570\u304c\u7528\u610f\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u30de\u30af\u30ed\u3068\u95a2\u6570\u306f\u3001DAG \u66f8\u304d\u8fbc\u307f\u306e\u30d7\u30ed\u30bb\u30b9\u3092\u5927\u5e45\u306b\u7c21\u7d20\u5316\u3057\u3001\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306e\u7d44\u307f\u8fbc\u307f\u30de\u30af\u30ed\u3068\u95a2\u6570\u306f\u3001\u4e3b\u306b\u6b21\u306e\u30ab\u30c6\u30b4\u30ea\u306b\u5206\u985e\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6642\u9593\u30de\u30af\u30ed: \u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b\u6642\u9593\u5f62\u5f0f\u3068\u6642\u9593\u8a08\u7b97\u95a2\u6570\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001<code>ds<\/code>\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u65e5\u3092\u793a\u3059\u3001<code>ds_nodash<\/code>\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u65e5\u3092\u793a\u3059\u3001\u9014\u4e2d\u306e\u30bb\u30d1\u30ec\u30fc\u30bf\u3092\u524a\u9664\u3059\u308b\u3001<code>execution_date<\/code>\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u523b\u3092\u793a\u3059\u3001<code>prev_ds<\/code>\u524d\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u65e5\u3092\u793a\u3059\u3001\u306a\u3069.&nbsp;\u3053\u308c\u3089\u306e\u6642\u9593\u30de\u30af\u30ed\u3092\u4f7f\u7528\u3057\u3066\u3001\u30d5\u30a1\u30a4\u30eb\u540d\u3001\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u540d\u3001SQL \u30af\u30a8\u30ea \u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u306a\u3069\u3092\u52d5\u7684\u306b\u751f\u6210\u3059\u308b\u306a\u3069\u306e\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u751f\u6210\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d5\u30a1\u30a4\u30eb \u30d1\u30b9 \u30de\u30af\u30ed: Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u3092\u793a\u3059\u3001\u30de\u30af\u30ed\u306e\u30b9\u30c8\u30ec\u30fc\u30b8 \u30d1\u30b9\u3092\u793a\u3059\u3001\u4e00\u6642\u30d5\u30a1\u30a4\u30eb \u30d1\u30b9\u3092\u793a\u3059\u306a\u3069\u3001<code>airflow_home<\/code>\u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b\u30d5\u30a1\u30a4\u30eb \u30d1\u30b9\u5f62\u5f0f\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d5\u30a1\u30a4\u30eb \u30d1\u30b9 \u30de\u30af\u30ed\u3092\u4f7f\u7528\u3057\u3066\u3001\u30d5\u30a1\u30a4\u30eb \u30d1\u30b9\u3084\u30c7\u30a3\u30ec\u30af\u30c8\u30ea \u30d1\u30b9\u306a\u3069\u3092\u52d5\u7684\u306b\u751f\u6210\u3059\u308b\u306a\u3069\u306e\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u751f\u6210\u3067\u304d\u307e\u3059\u3002<code>macros<\/code><code>tmp<\/code><\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u30de\u30af\u30ed: \u3044\u304f\u3064\u304b\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u6587\u5b57\u5217\u5f62\u5f0f\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001PostgreSQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u6587\u5b57\u5217<code>postgres_conn_id<\/code>\u3092\u8868\u3057\u305f\u308a\u3001&nbsp;<code>mysql_conn_id<\/code>MySQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u6587\u5b57\u5217\u3092\u8868\u3057\u305f\u308a\u3057\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u30de\u30af\u30ed\u3092\u4f7f\u7528\u3057\u3066\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3078\u306e\u52d5\u7684\u63a5\u7d9a\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u5185\u306e\u30c7\u30fc\u30bf\u306e\u8aad\u307f\u53d6\u308a\u306a\u3069\u306e\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u751f\u6210\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u5909\u63db\u95a2\u6570: JSON \u6587\u5b57\u5217\u304b\u3089 Python \u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3078\u306e\u5909\u63db\u3001\u6587\u5b57\u5217\u304b\u3089\u65e5\u6642\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3078\u306e\u5909\u63db\u306a\u3069\u3001<code>json.loads<\/code>\u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b\u30c7\u30fc\u30bf\u578b\u5909\u63db\u95a2\u6570\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<code>datetime.strptime<\/code>\u3053\u308c\u3089\u306e\u5909\u63db\u95a2\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001\u6587\u5b57\u5217\u578b\u3092\u6570\u5024\u578b\u3084\u65e5\u6642\u578b\u306a\u3069\u306b\u5909\u63db\u3059\u308b\u306a\u3069\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u51e6\u7406\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u6f14\u7b97\u95a2\u6570: \u5207\u308a\u4e0a\u3052\u95a2\u6570\u306e\u8868\u73fe\u3001\u6642\u5dee\u95a2\u6570\u306e\u8868\u73fe<code>math.ceil<\/code>\u306a\u3069\u3001\u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b\u6570\u5b66\u304a\u3088\u3073\u8ad6\u7406\u6f14\u7b97\u95a2\u6570\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<code>datetime.timedelta<\/code>\u3053\u308c\u3089\u306e\u7b97\u8853\u95a2\u6570\u3092\u4f7f\u7528\u3057\u3066\u30012 \u3064\u306e\u65e5\u6642\u306e\u6642\u9593\u5dee\u306e\u8a08\u7b97\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u9593\u306e\u8a08\u7b97\u306a\u3069\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u51e6\u7406\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b\u30de\u30af\u30ed\u3068\u95a2\u6570\u306e\u4f8b\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>from airflow import DAG\nfrom airflow.operators.bash_operator import BashOperator\nfrom airflow.operators.postgres_operator import PostgresOperator\nfrom datetime import datetime, timedelta\n\ndefault_args = {\n    'owner': 'airflow',\n    'start_date': datetime(2023, 1, 1),\n    'retries': 1,\n    'retry_delay': timedelta(minutes=5)\n}\n\ndag = DAG(\n    'my_dag',\n    default_args=default_args,\n    schedule_interval='@daily',\n    catchup=False\n)\n\nt1 = BashOperator(\n    task_id='task_1',\n    bash_command='echo \"{{ ds }} {{ ds_nodash }} {{ ts }} {{ ts_nodash }}\"',\n    dag=dag,\n)\n\nt2 = PostgresOperator(\n    task_id='task_2',\n    postgres_conn_id='my_postgres',\n    sql='SELECT * FROM my_table WHERE date = \\'{{ ds }}\\'',\n    dag=dag,\n)\n\nt3 = BashOperator(\n    task_id='task_3',\n   \n<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u7d9a\u3051\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">makefile\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>bash_command='echo \"{{ var.value.my_var | int + 1 }}\"',\ndag=dag,\n<\/code><\/pre>\n\n\n\n<p>)<\/p>\n\n\n\n<p>\u4e0a\u8a18\u306e DAG \u3067\u3001<code>{{ ds }}<\/code>\u3068 \u306f\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u65e5\u3092<code>{{ ds_nodash }}<\/code>\u305d\u308c\u305e\u308c\u3002<code>{{ ts }}<\/code>\u3068 \u306f\u3001\u73fe\u5728\u306e\u30bf\u30b9\u30af\u5b9f\u884c\u306e\u30bf\u30a4\u30e0\u30b9\u30bf\u30f3\u30d7\u3092\u8868\u3057\u307e\u3059\u3002<code>{{ ts_nodash }}<\/code>\u305d\u308c\u305e\u308c\u3002<code>{{ var.value.my_var | int + 1 }}<\/code>Airflow \u5909\u6570\u3092\u6574\u6570\u306b<code>my_var<\/code>\u5909\u63db\u3057\u3066\u3002<\/p>\n\n\n\n<p>\u7d44\u307f\u8fbc\u307f\u306e\u30de\u30af\u30ed\u3068\u95a2\u6570\u306b\u52a0\u3048\u3066\u3001Airflow \u306f\u30ab\u30b9\u30bf\u30e0 \u30de\u30af\u30ed\u3068\u95a2\u6570\u3082\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059\u3002\u6b21\u306e\u69cb\u6210\u3092 Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u306b\u8ffd\u52a0\u3057\u3066\u3001\u30ab\u30b9\u30bf\u30e0 \u30de\u30af\u30ed\u3068\u95a2\u6570\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u6307\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">iniCopy\u30b3\u30fc\u30c9<code>[core]\nuser_defined_macros = my_macros\nuser_defined_filters = my_filters\n<\/code><\/pre>\n\n\n\n<p><code>my_macros<\/code>\u3068 \u306f\u3001<code>my_filters<\/code>\u305d\u308c\u305e\u308c\u30ab\u30b9\u30bf\u30e0 \u30de\u30af\u30ed\u3068\u30d5\u30a3\u30eb\u30bf\u30fc\u304c\u914d\u7f6e\u3055\u308c\u3066\u3044\u308b Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3067\u3059\u3002\u30ab\u30b9\u30bf\u30e0 \u30de\u30af\u30ed\u3068\u30d5\u30a3\u30eb\u30bf\u30fc\u306f\u3001\u7279\u5b9a\u306e\u4ed5\u69d8\u306b\u5f93\u3063\u3066\u4f5c\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u8a73\u7d30\u306b\u3064\u3044\u3066\u306f\u3001\u516c\u5f0f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3092\u53c2\u7167\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3067\u306f\u3001\u30de\u30af\u30ed\u3068\u95a2\u6570\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001DAG \u306e\u8a18\u8ff0\u30d7\u30ed\u30bb\u30b9\u3092\u5927\u5e45\u306b\u7c21\u7d20\u5316\u3057\u3001\u30b3\u30fc\u30c9\u306e\u53ef\u8aad\u6027\u3068\u4fdd\u5b88\u6027\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u9069\u5207\u306a\u30de\u30af\u30ed\u3068\u95a2\u6570\u3092\u9078\u629e\u3057\u3066\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u51e6\u7406\u3057\u3001\u3088\u308a\u67d4\u8edf\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u914d\u7f6e\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u7528\u306e Airflow Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u4f7f\u7528\u3057\u3066\u3001Airflow \u306e\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3068\u30ed\u30ae\u30f3\u30b0\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u306f\u3001DAG\u3001\u30bf\u30b9\u30af\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u306a\u3069\u3092\u7c21\u5358\u306b\u76e3\u8996\u304a\u3088\u3073\u7ba1\u7406\u3059\u308b\u305f\u3081\u306e\u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3001\u30ed\u30b0\u51fa\u529b\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u9593\u306a\u3069\u306e\u8a73\u7d30\u60c5\u5831\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u30c8\u30e9\u30d6\u30eb\u30b7\u30e5\u30fc\u30c6\u30a3\u30f3\u30b0\u3092\u884c\u3044\u3001\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3092\u6700\u9069\u5316\u3059\u308b\u306e\u306b\u4fbf\u5229\u3067\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306b\u306f\u3001\u4e3b\u306b\u6b21\u306e\u90e8\u5206\u304c\u542b\u307e\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>DAG \u30ea\u30b9\u30c8 \u30da\u30fc\u30b8: DAG \u540d\u3001\u30b9\u30c6\u30fc\u30bf\u30b9\u3001\u6700\u7d42\u5b9f\u884c\u6642\u9593\u3001\u305d\u306e\u4ed6\u306e\u60c5\u5831\u3092\u542b\u3080\u3059\u3079\u3066\u306e DAG \u3092\u8868\u793a\u3057\u307e\u3059\u3002DAG \u306f\u3001\u30ea\u30b9\u30c8 \u30da\u30fc\u30b8\u3067\u958b\u59cb\u3001\u4e00\u6642\u505c\u6b62\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3001\u7de8\u96c6\u3001\u304a\u3088\u3073\u524a\u9664\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>DAG \u8a73\u7d30\u30da\u30fc\u30b8: DAG \u30bf\u30b9\u30af \u30ea\u30b9\u30c8\u3001\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u3001\u30bf\u30b9\u30af\u5b9f\u884c\u6642\u9593\u3001\u30bf\u30b9\u30af \u30ed\u30b0\u51fa\u529b\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u60c5\u5831\u3092\u542b\u3080\u3001\u6307\u5b9a\u3055\u308c\u305f DAG \u306e\u8a73\u7d30\u60c5\u5831\u3092\u8868\u793a\u3057\u307e\u3059\u3002\u8a73\u7d30\u30da\u30fc\u30b8\u3067\u3001\u30bf\u30b9\u30af\u3092\u958b\u59cb\u3001\u4e00\u6642\u505c\u6b62\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3001\u7de8\u96c6\u3001\u304a\u3088\u3073\u524a\u9664\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30ed\u30b0\u30da\u30fc\u30b8: \u6307\u5b9a\u3057\u305f\u30bf\u30b9\u30af\u306e\u30ed\u30b0\u51fa\u529b\u3092\u8868\u793a\u3057\u307e\u3059\u3002\u30ed\u30b0\u51fa\u529b\u306f\u3001\u6642\u9593\u3001\u30ec\u30d9\u30eb\u3001\u30bf\u30b9\u30af ID\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u6761\u4ef6\u306b\u5f93\u3063\u3066\u30d5\u30a3\u30eb\u30bf\u30ea\u30f3\u30b0\u3067\u304d\u307e\u3059\u3002\u30ed\u30b0 \u30da\u30fc\u30b8\u3067\u306f\u3001\u30bf\u30b9\u30af \u30ed\u30b0\u306e\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3001\u30bf\u30b9\u30af \u30ed\u30b0\u306e\u30af\u30ea\u30a2\u3001\u30bf\u30b9\u30af\u306e\u518d\u5b9f\u884c\u306a\u3069\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9 \u30da\u30fc\u30b8: \u30bf\u30b9\u30af\u306e\u958b\u59cb\u6642\u9593\u3001\u7d42\u4e86\u6642\u9593\u3001\u5b9f\u884c\u6642\u9593\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u60c5\u5831\u3092\u542b\u3080\u3001\u6307\u5b9a\u3055\u308c\u305f\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u5b9f\u884c\u6642\u9593\u3092\u8868\u793a\u3057\u307e\u3059\u3002\u30bf\u30b9\u30af \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9 \u30da\u30fc\u30b8\u304b\u3089\u3001\u30bf\u30b9\u30af\u306e\u518d\u5b9f\u884c\u3001\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u306e\u30af\u30ea\u30a2\u306a\u3069\u3092\u884c\u3046\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u7d71\u8a08\u30da\u30fc\u30b8: DAG \u306e\u6570\u3001\u30bf\u30b9\u30af\u306e\u6570\u3001\u30bf\u30b9\u30af\u306e\u6210\u529f\u7387\u306a\u3069\u306e\u60c5\u5831\u3092\u542b\u3080\u3001Airflow \u306e\u5168\u4f53\u7684\u306a\u7d71\u8a08\u3092\u8868\u793a\u3057\u307e\u3059\u3002\u7d71\u8a08\u30da\u30fc\u30b8\u3067\u306f\u3001\u3055\u307e\u3056\u307e\u306a\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u7d71\u8a08\u30c7\u30fc\u30bf\u3092\u8868\u793a\u304a\u3088\u3073\u30a8\u30af\u30b9\u30dd\u30fc\u30c8\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>Airflow \u306f\u3001Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306b\u52a0\u3048\u3066\u3001\u4fbf\u5229\u306a\u30ed\u30b0\u7ba1\u7406\u3068\u5206\u6790\u306e\u305f\u3081\u306e\u3055\u307e\u3056\u307e\u306a\u30ed\u30b0\u51fa\u529b\u65b9\u6cd5\u3082\u63d0\u4f9b\u3057\u307e\u3059\u3002\u30bf\u30b9\u30af\u30ed\u30b0\u306f\u3001\u30d5\u30a1\u30a4\u30eb\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3001\u30ed\u30b0\u30b5\u30fc\u30d0\u30fc\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30bf\u30fc\u30b2\u30c3\u30c8\u306b\u51fa\u529b\u3067\u304d\u308b\u305f\u3081\u3001\u30e6\u30fc\u30b6\u30fc\u306b\u3088\u308b\u96c6\u4e2d\u7ba1\u7406\u3068\u76e3\u8996\u304c\u5bb9\u6613\u306b\u306a\u308a\u307e\u3059\u3002\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u307e\u305f\u306f\u30b3\u30fc\u30c9\u3092\u4f7f\u7528\u3057\u3066\u30ed\u30b0\u51fa\u529b\u30e2\u30fc\u30c9\u3068\u30ec\u30d9\u30eb\u3092\u8a2d\u5b9a\u3057\u3001\u3055\u307e\u3056\u307e\u306a\u30ed\u30b0\u8981\u4ef6\u3092\u6e80\u305f\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3067\u306f\u3001Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3068\u30ed\u30b0\u51fa\u529b\u30e2\u30fc\u30c9\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u3092\u7c21\u5358\u306b\u76e3\u8996\u304a\u3088\u3073\u7ba1\u7406\u3067\u304d\u308b\u305f\u3081\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u4fdd\u5b88\u6027\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u9069\u5207\u306a\u76e3\u8996\u65b9\u6cd5\u3068\u30ed\u30b0\u51fa\u529b\u65b9\u6cd5\u3092\u9078\u629e\u3057\u3066\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u904b\u7528\u3068\u4fdd\u5b88\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u76e3\u8996\u3068\u30ed\u30b0\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 \u30bf\u30b9\u30af\u30ed\u30b0\u3092\u8868\u793a\u3059\u308b<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3001\u30b3\u30de\u30f3\u30c9\u30e9\u30a4\u30f3 \u30c4\u30fc\u30eb\u3001\u30ed\u30b0\u51fa\u529b\u30bf\u30fc\u30b2\u30c3\u30c8\u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u65b9\u6cd5\u3067\u30bf\u30b9\u30af \u30ed\u30b0\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3067\u306f\u3001\u6b21\u306e\u624b\u9806\u3067\u30bf\u30b9\u30af \u30ed\u30b0\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>DAG \u30ea\u30b9\u30c8 \u30da\u30fc\u30b8\u3067\u3001\u6307\u5b9a\u3057\u305f DAG \u3092\u9078\u629e\u3057\u3066 DAG \u306e\u8a73\u7d30\u30da\u30fc\u30b8\u306b\u5165\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>DAG \u306e\u8a73\u7d30\u30da\u30fc\u30b8\u3067\u3001\u6307\u5b9a\u3055\u308c\u305f\u30bf\u30b9\u30af\u3092\u9078\u629e\u3057\u3066\u30bf\u30b9\u30af \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9 \u30da\u30fc\u30b8\u306b\u5165\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af \u30a4\u30f3\u30b9\u30bf\u30f3\u30b9 \u30da\u30fc\u30b8\u3067\u3001\u30ed\u30b0 \u30dc\u30bf\u30f3\u3092\u30af\u30ea\u30c3\u30af\u3057\u3066\u30bf\u30b9\u30af \u30ed\u30b0 \u30da\u30fc\u30b8\u306b\u5165\u308a\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af \u30ed\u30b0 \u30da\u30fc\u30b8\u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u8a73\u7d30\u306a\u30ed\u30b0\u51fa\u529b\u3092\u8868\u793a\u3057\u3001\u6642\u9593\u3001\u30ec\u30d9\u30eb\u3001\u30bf\u30b9\u30af ID \u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u6761\u4ef6\u306b\u5f93\u3063\u3066\u30d5\u30a3\u30eb\u30bf\u30fc\u51e6\u7406\u3067\u304d\u307e\u3059\u3002\u540c\u6642\u306b\u3001\u30bf\u30b9\u30af \u30ed\u30b0\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3001\u30bf\u30b9\u30af \u30ed\u30b0\u3092\u30af\u30ea\u30a2\u3057\u3066\u3001\u30bf\u30b9\u30af \u30ed\u30b0 \u30da\u30fc\u30b8\u3067\u30bf\u30b9\u30af\u3092\u518d\u5b9f\u884c\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u306b\u52a0\u3048\u3066\u3001\u30b3\u30de\u30f3\u30c9 \u30e9\u30a4\u30f3 \u30c4\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af \u30ed\u30b0\u3092<code>airflow logs<\/code>\u8868\u793a\u3059\u308b\u3002\u6b21\u306e\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001\u7279\u5b9a\u306e\u30bf\u30b9\u30af\u306e\u30ed\u30b0\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">php\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>airflow logs &lt;dag_id&gt; &lt;task_id&gt; --execution-date &lt;date&gt;\n<\/code><\/pre>\n\n\n\n<p>\u3053\u306e\u3046\u3061\u3001 \u306f<code>&lt;dag_id&gt;<\/code>DAG \u306e\u540d\u524d\u3092\u793a\u3057\u3001<code>&lt;task_id&gt;<\/code>\u30bf\u30b9\u30af\u306e\u540d\u524d\u3092\u793a\u3057\u3001<code>&lt;date&gt;<\/code>\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u3055\u308c\u305f\u65e5\u4ed8\u3092\u793a\u3057\u307e\u3059\u3002\u3053\u306e\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u8a73\u7d30\u306a\u30ed\u30b0\u51fa\u529b\u3092\u8868\u793a\u3067\u304d\u307e\u3059\u3002\u30ed\u30b0\u51fa\u529b\u306f\u3001\u6642\u9593\u3001\u30ec\u30d9\u30eb\u3001\u304a\u3088\u3073\u305d\u306e\u4ed6\u306e\u6761\u4ef6\u306b\u5f93\u3063\u3066\u30d5\u30a3\u30eb\u30bf\u30ea\u30f3\u30b0\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u4e0a\u8a18\u306e\u65b9\u6cd5\u306b\u52a0\u3048\u3066\u3001\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u307e\u305f\u306f\u30b3\u30fc\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001\u30ed\u30b0\u306e\u51fa\u529b\u65b9\u6cd5\u3068\u30ec\u30d9\u30eb\u3092\u8a2d\u5b9a\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u3059\u3002\u30bf\u30b9\u30af\u30ed\u30b0\u306f\u3001\u30d5\u30a1\u30a4\u30eb\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3001\u30ed\u30b0\u30b5\u30fc\u30d0\u30fc\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u30bf\u30fc\u30b2\u30c3\u30c8\u306b\u51fa\u529b\u3067\u304d\u308b\u305f\u3081\u3001\u30e6\u30fc\u30b6\u30fc\u306b\u3088\u308b\u96c6\u4e2d\u7ba1\u7406\u3068\u76e3\u8996\u304c\u5bb9\u6613\u306b\u306a\u308a\u307e\u3059\u3002\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u9069\u5207\u306a\u30ed\u30b0\u51fa\u529b\u30e2\u30fc\u30c9\u3068\u30ec\u30d9\u30eb\u3092\u9078\u629e\u3057\u3066\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u904b\u7528\u3068\u4fdd\u5b88\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af \u30ed\u30b0\u3092\u7c21\u5358\u306b\u8868\u793a\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u4fdd\u5b88\u6027\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u7279\u5b9a\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u9069\u5207\u306a\u30ed\u30b0\u51fa\u529b\u30e2\u30fc\u30c9\u3068\u30ec\u30d9\u30eb\u3092\u9078\u629e\u3057\u3066\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u306e\u76e3\u8996\u3068\u7ba1\u7406\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u76e3\u8996\u3068\u30ed\u30b0\u8a2d\u5b9a\u306e\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA (\u30b5\u30fc\u30d3\u30b9 \u30ec\u30d9\u30eb \u30a2\u30b0\u30ea\u30fc\u30e1\u30f3\u30c8) \u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u901a\u3058\u3066\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u76e3\u8996\u304a\u3088\u3073\u7ba1\u7406\u3067\u304d\u307e\u3059\u3002\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u306b\u306f\u3001\u5b8c\u4e86\u3001\u5b9f\u884c\u4e2d\u3001\u5f85\u6a5f\u4e2d\u3001\u5931\u6557\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u72b6\u614b\u3092\u542b\u3080\u3001\u30bf\u30b9\u30af\u306e\u73fe\u5728\u306e\u72b6\u614b\u304c\u53cd\u6620\u3055\u308c\u307e\u3059\u3002SLA \u3068\u306f\u3001\u6307\u5b9a\u3055\u308c\u305f\u6642\u9593\u5185\u306b\u30bf\u30b9\u30af\u3092\u5b8c\u4e86\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u3068\u3044\u3046\u5408\u610f\u3092\u6307\u3057\u3001\u30bf\u30b9\u30af\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u3068\u4fe1\u983c\u6027\u3092\u6e2c\u5b9a\u3059\u308b\u305f\u3081\u306b\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow \u306e\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u30e1\u30ab\u30cb\u30ba\u30e0\u306f\u3001\u6b21\u306e\u65b9\u6cd5\u3067\u8a2d\u5b9a\u304a\u3088\u3073\u76e3\u8996\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u306e\u8a2d\u5b9a<\/li>\n<\/ol>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u306f\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002\u6b21\u306e\u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af\u306e\u6700\u5f8c\u306b\u3001PythonOperator \u3068 xcom_push \u30e1\u30bd\u30c3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u72b6\u614b\u3092 XComs \u306b\u66f8\u304d\u8fbc\u307f\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>def my_task(**context):\n    # \u6267\u884c\u4efb\u52a1\u903b\u8f91\n    task_status = 'success' # or 'failed'\n    context['ti'].xcom_push(key='task_status', value=task_status)\n\nmy_task_operator = PythonOperator(\n    task_id='my_task',\n    python_callable=my_task,\n    provide_context=True,\n    dag=dag,\n)\n<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af\u306e\u6700\u5f8c\u306b\u3001BashOperator \u304a\u3088\u3073 airflow CLI \u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9 \u30d5\u30a1\u30a4\u30eb\u306b\u66f8\u304d\u8fbc\u307f\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-preformatted\">python\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>my_task_operator = BashOperator(\n    task_id='my_task',\n    bash_command='echo \"success\" &gt; \/tmp\/my_task_status',\n    dag=dag,\n)\n\nmy_task_operator.set_downstream(set_task_state_op)\n<\/code><\/pre>\n\n\n\n<p>\u305d\u306e\u4e2d\u3067\u3001<code>set_task_state_op<\/code>\u7279\u5b9a\u306e\u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u8a2d\u5b9a\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u8868\u3059\u6f14\u7b97\u5b50\u3092\u9078\u629e\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u3092\u76e3\u8996\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u306f\u3001Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3067\u76e3\u8996\u3067\u304d\u307e\u3059\u3002DAG \u306e\u8a73\u7d30\u30da\u30fc\u30b8\u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068\u3001SLA \u304c\u8981\u4ef6\u3092\u6e80\u305f\u3057\u3066\u3044\u308b\u304b\u3069\u3046\u304b\u3092\u78ba\u8a8d\u3067\u304d\u307e\u3059\u3002\u540c\u6642\u306b\u30a2\u30e9\u30fc\u30e0\u3084\u901a\u77e5\u3092\u30e1\u30fc\u30eb\u3084Slack\u306a\u3069\u3067\u9001\u4fe1\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3084\u4fdd\u5b88\u6027\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u30bf\u30b9\u30af \u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u30e1\u30ab\u30cb\u30ba\u30e0\u306b\u52a0\u3048\u3066\u3001Airflow \u306f\u3001\u30bf\u30b9\u30af\u306e\u76e3\u8996\u3068\u7ba1\u7406\u3092\u5bb9\u6613\u306b\u3059\u308b\u3055\u307e\u3056\u307e\u306a\u76e3\u8996\u304a\u3088\u3073\u30a2\u30e9\u30fc\u30e0 \u30e1\u30ab\u30cb\u30ba\u30e0\u3082\u63d0\u4f9b\u3057\u307e\u3059\u3002\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u9069\u5207\u306a\u76e3\u8996\u3068\u30a2\u30e9\u30fc\u30e0\u306e\u65b9\u6cd5\u3092\u9078\u629e\u3057\u3066\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u904b\u7528\u3068\u4fdd\u5b88\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3068 SLA \u3092\u7c21\u5358\u306b\u8a2d\u5b9a\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u4fdd\u5b88\u6027\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u306b\u5fdc\u3058\u3066\u3001\u9069\u5207\u306a\u76e3\u8996\u304a\u3088\u3073\u30a2\u30e9\u30fc\u30e0 \u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u9078\u629e\u3057\u3066\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u52b9\u7387\u7684\u306a\u30bf\u30b9\u30af \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u304a\u3088\u3073\u904b\u7528\u3068\u4fdd\u5b88\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Docker \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b Airflow \u306e\u30c7\u30d7\u30ed\u30a4\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Docker \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u3068\u3001\u30c7\u30d7\u30ed\u30a4\u3068\u7ba1\u7406\u306e\u30d7\u30ed\u30bb\u30b9\u304c\u7c21\u7d20\u5316\u3055\u308c\u3001\u30c7\u30d7\u30ed\u30a4\u306e\u52b9\u7387\u3068\u4fdd\u5b88\u6027\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002Docker \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u4e00\u822c\u7684\u306a\u624b\u9806\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Docker \u3068 Docker Compose \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li><code>docker-compose.yml<\/code>Airflow \u30b3\u30f3\u30c6\u30ca\u3068\u95a2\u9023\u3059\u308b\u4f9d\u5b58\u95a2\u4fc2\u3092\u69cb\u6210\u3059\u308b\u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">yaml\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>version: '3'\n\nservices:\n  postgres:\n    image: postgres:13\n    environment:\n      POSTGRES_USER: postgres\n      POSTGRES_PASSWORD: postgres\n      POSTGRES_DB: airflow\n\n  redis:\n    image: redis:latest\n\n  webserver:\n    build:\n      context: .\n      dockerfile: Dockerfile\n    depends_on:\n      - postgres\n      - redis\n    environment:\n      - POSTGRES_USER=postgres\n      - POSTGRES_PASSWORD=postgres\n      - POSTGRES_DB=airflow\n      - REDIS_HOST=redis\n      - EXECUTOR=CeleryExecutor\n      - FERNET_KEY=${FERNET_KEY}\n    ports:\n      - \"8080:8080\"\n    volumes:\n      - .\/dags:\/usr\/local\/airflow\/dags\n      - .\/logs:\/usr\/local\/airflow\/logs\n      - .\/plugins:\/usr\/local\/airflow\/plugins\n<\/code><\/pre>\n\n\n\n<p>\u3053\u306e\u3046\u3061\u3001 \u306f<code>webserver<\/code>Airflow Web \u30b5\u30fc\u30d0\u30fc\u3092\u793a\u3057\u3001<code>postgres<\/code>Airflow \u304c\u4f7f\u7528\u3059\u308b PostgreSQL \u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u3092\u793a\u3057\u3001<code>redis<\/code>Airflow \u304c\u4f7f\u7528\u3059\u308b Redis \u30b5\u30fc\u30d0\u30fc\u3092\u793a\u3057\u307e\u3059\u3002<code>volumes<\/code>\u3053\u306e\u5c5e\u6027\u306f\u3001\u30b3\u30f3\u30c6\u30ca\u3068\u30db\u30b9\u30c8\u9593\u306e\u30c7\u30fc\u30bf \u30de\u30a6\u30f3\u30c8\u3092\u8868\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li><code>Dockerfile<\/code>Airflow \u30b3\u30f3\u30c6\u30ca \u30a4\u30e1\u30fc\u30b8\u3092\u69cb\u6210\u3059\u308b\u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-preformatted\">dockerfile\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc\u3059\u308b<code>FROM apache\/airflow:2.2.0\nRUN pip install --no-cache-dir redis\n<\/code><\/pre>\n\n\n\n<p>\u3053\u306e\u3046\u3061\u3001 \u306f<code>apache\/airflow:2.2.0<\/code>Airflow \u30b3\u30f3\u30c6\u30ca \u30a4\u30e1\u30fc\u30b8\u306e\u30d0\u30fc\u30b8\u30e7\u30f3\u3092\u793a\u3057\u3001<code>RUN<\/code>\u30b3\u30de\u30f3\u30c9\u306f Redis \u30af\u30e9\u30a4\u30a2\u30f3\u30c8 \u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3092\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li><code>docker-compose up<\/code>\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066Airflow \u30b3\u30f3\u30c6\u30ca\u3092\u8d77\u52d5\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>Airflow \u30b3\u30f3\u30c6\u30ca\u304c\u5c55\u958b\u3055\u308c\u305f\u5f8c\u3001\u6b21\u306e\u5074\u9762\u3092\u542b\u3081\u3001\u30b3\u30f3\u30c6\u30ca\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u3055\u3089\u306b\u6539\u5584\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>HTTPS \u30d7\u30ed\u30c8\u30b3\u30eb\u3092\u4f7f\u7528\u3057\u3066 Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3068 API \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u4fdd\u8b77\u3057\u3001\u30c7\u30fc\u30bf\u306e\u4e57\u3063\u53d6\u308a\u3084\u76d7\u96e3\u3092\u9632\u304e\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d1\u30b9\u30ef\u30fc\u30c9\u3084\u30ad\u30fc\u306a\u3069\u306e\u8a8d\u8a3c\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u6a5f\u5bc6\u30c7\u30fc\u30bf\u3068\u64cd\u4f5c\u3092\u4fdd\u8b77\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b3\u30f3\u30c6\u30ca\u306f\u5b9a\u671f\u7684\u306b\u66f4\u65b0\u304a\u3088\u3073\u76e3\u8996\u3055\u308c\u3001\u5b89\u5168\u6027\u304c\u78ba\u4fdd\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b3\u30f3\u30c6\u30ca\u30fc \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30c4\u30fc\u30eb\u3068\u30b5\u30fc\u30d3\u30b9 \u30ec\u30b8\u30b9\u30c8\u30ea\u3092\u4f7f\u7528\u3057\u3066\u3001\u30b3\u30f3\u30c6\u30ca\u30fc\u306e\u81ea\u52d5\u5316\u3068\u4fdd\u5b88\u6027\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3064\u307e\u308a\u3001Docker \u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u3068\u3001\u30c7\u30d7\u30ed\u30a4\u306e\u52b9\u7387\u3068\u4fdd\u5b88\u6027\u304c\u5411\u4e0a\u3059\u308b\u3068\u540c\u6642\u306b\u3001\u30b3\u30f3\u30c6\u30ca\u30fc\u306e\u4fe1\u983c\u6027\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u78ba\u4fdd\u3059\u308b\u305f\u3081\u306b\u3001\u30b3\u30f3\u30c6\u30ca\u30fc\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u76e3\u8996\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u5f37\u5316\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30c7\u30d7\u30ed\u30a4\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u306e Airflow \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u30c7\u30d7\u30ed\u30a4\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u30c7\u30d7\u30ed\u30a4\u3068\u306f\u3001\u9ad8\u53ef\u7528\u6027\u3068\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3092\u5b9f\u73fe\u3059\u308b\u305f\u3081\u306b Airflow \u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3092\u8907\u6570\u306e\u30ce\u30fc\u30c9\u306b\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u3053\u3068\u3092\u6307\u3057\u307e\u3059\u3002Airflow \u30af\u30e9\u30b9\u30bf\u306e\u30c7\u30d7\u30ed\u30a4\u3067\u306f\u3001\u6b21\u306e\u5074\u9762\u3092\u8003\u616e\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5c55\u958b\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3<\/li>\n<\/ol>\n\n\n\n<p>Airflow \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u30c7\u30d7\u30ed\u30a4 \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306f\u3001\u30de\u30b9\u30bf\u30fc\/\u30b9\u30ec\u30fc\u30d6 \u30e2\u30fc\u30c9\u3001\u5206\u6563\u30e2\u30fc\u30c9\u3001\u30cf\u30a4\u30d6\u30ea\u30c3\u30c9 \u30e2\u30fc\u30c9\u306a\u3069\u3001\u3055\u307e\u3056\u307e\u306a\u5f62\u5f0f\u3092\u53d6\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u30de\u30b9\u30bf\u30fc\/\u30b9\u30ec\u30fc\u30d6 \u30e2\u30fc\u30c9\u3068\u306f\u3001Airflow \u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3092 2 \u3064\u306e\u30ce\u30fc\u30c9\u306b\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u3053\u3068\u3092\u6307\u3057\u307e\u3059\u3002\u305d\u306e\u3046\u3061\u306e 1 \u3064\u306f\u30de\u30b9\u30bf\u30fc \u30ce\u30fc\u30c9\u3067\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u7ba1\u7406\u3092\u62c5\u5f53\u3057\u3001\u3082\u3046 1 \u3064\u306e\u30ce\u30fc\u30c9\u306f\u30b9\u30ec\u30fc\u30d6 \u30ce\u30fc\u30c9\u3067\u3001\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u62c5\u5f53\u3057\u307e\u3059\u3002\u5206\u6563\u30e2\u30fc\u30c9\u3068\u306f\u3001\u8907\u6570\u306e\u30ce\u30fc\u30c9\u306b Airflow \u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3092\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u3053\u3068\u3092\u6307\u3057\u3001\u30ce\u30fc\u30c9\u306e\u6570\u3068\u69cb\u6210\u65b9\u6cd5\u306f\u3001\u3055\u307e\u3056\u307e\u306a\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3068\u30ea\u30bd\u30fc\u30b9\u69cb\u6210\u306b\u5f93\u3063\u3066\u9078\u629e\u3067\u304d\u307e\u3059\u3002\u30cf\u30a4\u30d6\u30ea\u30c3\u30c9 \u30e2\u30fc\u30c9\u3068\u306f\u3001Airflow \u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3092\u8907\u6570\u306e\u30ce\u30fc\u30c9\u306b\u30c7\u30d7\u30ed\u30a4\u3059\u308b\u3053\u3068\u3092\u6307\u3057\u3001\u30de\u30b9\u30bf\u30fc\/\u30b9\u30ec\u30fc\u30d6 \u30e2\u30fc\u30c9\u3068\u5206\u6563\u30e2\u30fc\u30c9\u3092\u540c\u6642\u306b\u4f7f\u7528\u3057\u3066\u3001\u3088\u308a\u67d4\u8edf\u3067\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30c7\u30d7\u30ed\u30a4 \u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u30e1\u30ab\u30cb\u30ba\u30e0<\/li>\n<\/ol>\n\n\n\n<p>Airflow \u30af\u30e9\u30b9\u30bf\u306e\u30c7\u30d7\u30ed\u30a4\u306b\u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u5f37\u5316\u3055\u308c\u305f\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30e1\u30ab\u30cb\u30ba\u30e0\u304c\u5fc5\u8981\u3067\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>HTTPS \u30d7\u30ed\u30c8\u30b3\u30eb\u3092\u4f7f\u7528\u3057\u3066 Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3068 API \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u4fdd\u8b77\u3057\u3001\u30c7\u30fc\u30bf\u306e\u4e57\u3063\u53d6\u308a\u3084\u76d7\u96e3\u3092\u9632\u304e\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d1\u30b9\u30ef\u30fc\u30c9\u3084\u30ad\u30fc\u306a\u3069\u306e\u8a8d\u8a3c\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u6a5f\u5bc6\u30c7\u30fc\u30bf\u3068\u64cd\u4f5c\u3092\u4fdd\u8b77\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b3\u30f3\u30c6\u30ca\u306f\u5b9a\u671f\u7684\u306b\u66f4\u65b0\u304a\u3088\u3073\u76e3\u8996\u3055\u308c\u3001\u5b89\u5168\u6027\u304c\u78ba\u4fdd\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b3\u30f3\u30c6\u30ca\u30fc \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30c4\u30fc\u30eb\u3068\u30b5\u30fc\u30d3\u30b9 \u30ec\u30b8\u30b9\u30c8\u30ea\u3092\u4f7f\u7528\u3057\u3066\u3001\u30b3\u30f3\u30c6\u30ca\u30fc\u306e\u81ea\u52d5\u5316\u3068\u4fdd\u5b88\u6027\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d5\u30a1\u30a4\u30a2\u30a6\u30a9\u30fc\u30eb\u3068\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u5206\u96e2\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u5916\u90e8\u304b\u3089\u306e\u653b\u6483\u3068\u5185\u90e8\u30ea\u30fc\u30af\u3092\u9632\u304e\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u9ad8\u53ef\u7528\u6027<\/li>\n<\/ol>\n\n\n\n<p>Airflow \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u30c7\u30d7\u30ed\u30a4\u3067\u306f\u3001\u5358\u4e00\u969c\u5bb3\u70b9\u306b\u3088\u308b\u30bf\u30b9\u30af\u5b9f\u884c\u306e\u5931\u6557\u3092\u9632\u3050\u305f\u3081\u306b\u3001\u9ad8\u53ef\u7528\u6027\u3092\u78ba\u4fdd\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u9ad8\u53ef\u7528\u6027\u306f\u3001\u6b21\u306e\u65b9\u6cd5\u3067\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u30ed\u30fc\u30c9 \u30d0\u30e9\u30f3\u30b5\u30fc\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af \u30ea\u30af\u30a8\u30b9\u30c8\u3092\u8907\u6570\u306e\u30ce\u30fc\u30c9\u306b\u5206\u6563\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30de\u30b9\u30bf\u30fc\/\u30b9\u30ec\u30fc\u30d6 \u30e2\u30fc\u30c9\u3092\u4f7f\u7528\u3057\u3066\u3001\u30de\u30b9\u30bf\u30fc \u30ce\u30fc\u30c9\u304c\u969c\u5bb3\u6642\u306b\u30b9\u30ec\u30fc\u30d6 \u30ce\u30fc\u30c9\u306b\u81ea\u52d5\u7684\u306b\u5207\u308a\u66ff\u308f\u308b\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30c7\u30fc\u30bf\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u56de\u5fa9\u306e\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af \u30c7\u30fc\u30bf\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u6574\u5408\u6027\u3092\u78ba\u4fdd\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30b3\u30f3\u30c6\u30ca\u30fc \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30c4\u30fc\u30eb\u3068\u30b3\u30f3\u30c6\u30ca\u30fc \u30b5\u30fc\u30d3\u30b9 \u30ec\u30b8\u30b9\u30c8\u30ea\u3092\u4f7f\u7528\u3057\u3066\u3001\u30b3\u30f3\u30c6\u30ca\u30fc\u306e\u5f3e\u529b\u6027\u3068\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3092\u5411\u4e0a\u3055\u305b\u307e\u3059\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u30c7\u30d7\u30ed\u30a4\u306e\u30d7\u30ed\u30bb\u30b9\u3067\u306f\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3068\u30ea\u30bd\u30fc\u30b9\u69cb\u6210\u306b\u5f93\u3063\u3066\u3001\u9069\u5207\u306a\u30c7\u30d7\u30ed\u30a4 \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u9078\u629e\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b\u3068\u540c\u6642\u306b\u3001\u9ad8\u53ef\u7528\u6027\u3068\u4fdd\u5b88\u6027\u3092\u78ba\u4fdd\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3068\u5b89\u5b9a\u6027\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u5c55\u958b\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u69cb\u6210\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 Airflow \u306e\u8a8d\u8a3c\u3068\u8a8d\u53ef\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u306e\u8a8d\u8a3c\u3068\u627f\u8a8d\u306f\u3001Airflow \u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3092\u4fdd\u8b77\u3059\u308b\u305f\u3081\u306e\u91cd\u8981\u306a\u624b\u6bb5\u3067\u3042\u308a\u3001Airflow Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3068 API \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3078\u306e\u30e6\u30fc\u30b6\u30fc\u306e\u30a2\u30af\u30bb\u30b9\u3068\u64cd\u4f5c\u3092\u5236\u9650\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u3055\u307e\u3056\u307e\u306a\u8a8d\u8a3c\u304a\u3088\u3073\u627f\u8a8d\u65b9\u6cd5\u3092\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u57fa\u672c\u8a8d\u8a3c<\/li>\n<\/ol>\n\n\n\n<p>\u57fa\u672c\u8a8d\u8a3c\u306f\u6700\u3082\u5358\u7d14\u306a\u8a8d\u8a3c\u65b9\u6cd5\u3067\u3042\u308a\u3001\u30e6\u30fc\u30b6\u30fc\u306f\u30e6\u30fc\u30b6\u30fc\u540d\u3068\u30d1\u30b9\u30ef\u30fc\u30c9\u306b\u3088\u3063\u3066\u8a8d\u8a3c\u3055\u308c\u307e\u3059\u3002Airflow Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u306f\u3001Apache \u3084 Nginx \u306a\u3069\u306e Web \u30b5\u30fc\u30d0\u30fc\u304c\u63d0\u4f9b\u3059\u308b Basic \u8a8d\u8a3c\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066\u8a8d\u8a3c\u3067\u304d\u307e\u3059\u3002Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u306f<code>webserver_authenticate<\/code>\u3001<code>webserver_user<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u8a2d\u5b9a\u3057\u3066\u57fa\u672c\u8a8d\u8a3c\u3092\u6709\u52b9\u306b\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u540d\u3068\u30d1\u30b9\u30ef\u30fc\u30c9\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>LDAP \u8a8d\u8a3c<\/li>\n<\/ol>\n\n\n\n<p>LDAP \u8a8d\u8a3c\u306f\u3001\u65e2\u5b58\u306e LDAP \u30c7\u30a3\u30ec\u30af\u30c8\u30ea \u30b5\u30fc\u30d3\u30b9\u3092\u4f7f\u7528\u3057\u3066\u30e6\u30fc\u30b6\u30fc\u3092\u8a8d\u8a3c\u3067\u304d\u308b\u3001\u4e00\u822c\u7684\u306a\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba \u30ec\u30d9\u30eb\u306e\u8a8d\u8a3c\u65b9\u6cd5\u3067\u3059\u3002Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u306f<code>authenticate<\/code>\u3001<code>auth_backend<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u8a2d\u5b9a\u3057\u3066 LDAP \u8a8d\u8a3c\u3092\u6709\u52b9\u306b\u3057\u3001LDAP \u30b5\u30fc\u30d0\u30fc\u3068\u30e6\u30fc\u30b6\u30fc\u60c5\u5831\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>OAuth2 \u8a8d\u8a3c<\/li>\n<\/ol>\n\n\n\n<p>OAuth2\u8a8d\u8a3c\u306f\u3001\u30b7\u30f3\u30b0\u30eb\u30b5\u30a4\u30f3\u30aa\u30f3\u3084\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u8a8d\u53ef\u306a\u3069\u306e\u6a5f\u80fd\u3092\u5b9f\u88c5\u3067\u304d\u308b\u30c8\u30fc\u30af\u30f3\u30d9\u30fc\u30b9\u306e\u8a8d\u8a3c\u65b9\u5f0f\u3067\u3059\u3002Airflow \u3067\u306f\u3001Flask-AppBuilder \u304c\u63d0\u4f9b\u3059\u308b OAuth2 \u8a8d\u8a3c\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001Airflow Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u8a8d\u8a3c\u3067\u304d\u307e\u3059\u3002Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u306f<code>rbac<\/code>\u3001<code>auth_type<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u8a2d\u5b9a\u3057\u3066 OAuth2 \u8a8d\u8a3c\u3092\u6709\u52b9\u306b\u3057\u3001OAuth2 \u30b5\u30fc\u30d0\u30fc\u3068\u30af\u30e9\u30a4\u30a2\u30f3\u30c8\u306e\u60c5\u5831\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>RBAC \u627f\u8a8d<\/li>\n<\/ol>\n\n\n\n<p>RBAC \u627f\u8a8d\u306f\u30ed\u30fc\u30eb\u30d9\u30fc\u30b9\u306e\u627f\u8a8d\u65b9\u6cd5\u3067\u3042\u308a\u3001Airflow Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3068 API \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3078\u306e\u30e6\u30fc\u30b6\u30fc\u306e\u30a2\u30af\u30bb\u30b9\u6a29\u3068\u64cd\u4f5c\u6a29\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002Airflow \u3067\u306f\u3001Flask-AppBuilder \u304c\u63d0\u4f9b\u3059\u308b RBAC \u627f\u8a8d\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066\u3001Airflow Web \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30a4\u30b9\u3092\u627f\u8a8d\u3067\u304d\u307e\u3059\u3002Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001<code>rbac<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u5c55\u958b\u306e\u30d7\u30ed\u30bb\u30b9\u3067\u306f\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u8981\u4ef6\u306b\u5fdc\u3058\u3066\u9069\u5207\u306a\u8a8d\u8a3c\u304a\u3088\u3073\u627f\u8a8d\u65b9\u6cd5\u3092\u9078\u629e\u3057\u3001Airflow \u30b7\u30b9\u30c6\u30e0\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3068\u5b89\u5b9a\u6027\u3092\u78ba\u4fdd\u3059\u308b\u305f\u3081\u306b\u30e6\u30fc\u30b6\u30fc\u6a29\u9650\u3092\u53b3\u5bc6\u306b\u5236\u9650\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 Operator \u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u306e\u5c0e\u5165\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 Operator \u30d7\u30e9\u30b0\u30a4\u30f3\u306f\u3001Airflow \u6a5f\u80fd\u3092\u62e1\u5f35\u3059\u308b\u305f\u3081\u306e\u91cd\u8981\u306a\u624b\u6bb5\u3067\u3059. \u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3068\u30ea\u30bd\u30fc\u30b9\u69cb\u6210\u306b\u5fdc\u3058\u3066\u3001\u4e00\u90e8\u306e\u65b0\u3057\u3044 Operator \u3068\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3057\u3066\u3001\u30bf\u30b9\u30af \u30d7\u30ed\u30bb\u30b9\u306e\u7ba1\u7406\u3068\u5b9f\u884c\u3092\u3088\u308a\u9069\u5207\u306b\u30b5\u30dd\u30fc\u30c8\u3067\u304d\u307e\u3059.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Operator \u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u306e\u7d39\u4ecb<\/li>\n<\/ol>\n\n\n\n<p>Operator \u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u306f\u3001\u65e2\u5b58\u306e Operator \u6a5f\u80fd\u3092\u62e1\u5f35\u3057\u305f\u308a\u3001\u65b0\u3057\u3044 Operator \u30bf\u30a4\u30d7\u3092\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3057\u305f\u308a\u3059\u308b\u305f\u3081\u306b Airflow \u306b\u3088\u3063\u3066\u63d0\u4f9b\u3055\u308c\u308b\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002Airflow \u3067\u306f\u3001\u65b0\u3057\u3044 Operator \u30bf\u30a4\u30d7\u3092\u8ffd\u52a0\u3057\u305f\u308a\u3001Operator \u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u3092\u4ecb\u3057\u3066\u65e2\u5b58\u306e Operator \u30bf\u30a4\u30d7\u3092\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3057\u305f\u308a\u3057\u3066\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3092\u6e80\u305f\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002Operator \u30d7\u30e9\u30b0\u30a4\u30f3 \u30b7\u30b9\u30c6\u30e0\u306f Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u5b9f\u88c5\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u306e\u30e2\u30b8\u30e5\u30fc\u30eb\u306b\u306f\u3001Operator \u30af\u30e9\u30b9\u3068\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306a\u3069\u306e\u3044\u304f\u3064\u304b\u306e\u8ffd\u52a0\u6a5f\u80fd\u304c\u542b\u307e\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3<\/li>\n<\/ol>\n\n\n\n<p>Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u306f\u3001Hook\u3001Sensor\u3001Macro\u3001Executor\u3001Web UI \u306a\u3069\u3001Airflow \u306e\u6a5f\u80fd\u3092\u62e1\u5f35\u3059\u308b\u305f\u3081\u306e\u4e00\u822c\u7684\u306a\u30d7\u30e9\u30b0\u30a4\u30f3 \u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002Airflow \u3067\u306f\u3001\u30d5\u30c3\u30af\u3084\u30bb\u30f3\u30b5\u30fc\u306e\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u3001Executor \u306e\u62e1\u5f35\u3001\u30ab\u30b9\u30bf\u30e0 Web UI \u30da\u30fc\u30b8\u306e\u8ffd\u52a0\u306a\u3069\u3001\u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u4ecb\u3057\u3066\u3044\u304f\u3064\u304b\u306e\u8ffd\u52a0\u6a5f\u80fd\u3092\u5b9f\u88c5\u3067\u304d\u307e\u3059\u3002\u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u306f Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u5b9f\u88c5\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u306e\u30e2\u30b8\u30e5\u30fc\u30eb\u306b\u306f\u3001<code>defaul_plugin<\/code>\u95a2\u6570\u3001<code>hooks<\/code>\u30af\u30e9\u30b9\u3001\u30af\u30e9\u30b9<code>operators<\/code>\u306a\u3069\u306e\u7279\u5b9a\u306e\u95a2\u6570\u3068\u30af\u30e9\u30b9\u304c\u542b\u307e\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 Operator \u30d7\u30e9\u30b0\u30a4\u30f3\u306f\u3001Airflow \u6a5f\u80fd\u3092\u62e1\u5f35\u3059\u308b\u305f\u3081\u306e\u91cd\u8981\u306a\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059.\u4e00\u90e8\u306e\u65b0\u3057\u3044 Operator \u3068\u30d7\u30e9\u30b0\u30a4\u30f3\u306f\u3001\u30bf\u30b9\u30af\u306e\u7ba1\u7406\u3068\u5b9f\u884c\u3092\u3088\u308a\u9069\u5207\u306b\u30b5\u30dd\u30fc\u30c8\u3059\u308b\u305f\u3081\u306b\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3068\u30ea\u30bd\u30fc\u30b9\u69cb\u6210\u306b\u5f93\u3063\u3066\u30ab\u30b9\u30bf\u30de\u30a4\u30ba\u304a\u3088\u3073\u5b9f\u88c5\u3067\u304d\u307e\u3059\u3002\u30d7\u30ed\u30bb\u30b9\u3002\u3053\u308c\u3089\u306e\u62e1\u5f35\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3059\u308b\u3053\u3068\u3067\u3001Airflow \u306e\u67d4\u8edf\u6027\u3068\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u304c\u5927\u5e45\u306b\u5411\u4e0a\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u306b\u3088\u308a\u826f\u3044\u30bf\u30b9\u30af \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u7ba1\u7406\u30a8\u30af\u30b9\u30da\u30ea\u30a8\u30f3\u30b9\u304c\u63d0\u4f9b\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u8a18\u8ff0\u3059\u308b\u305f\u3081\u306e Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 Operator \u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n<p>Airflow \u30ab\u30b9\u30bf\u30e0 Operator \u306f<code>BaseOperator<\/code>\u3001<code>execute()<\/code>\u30af\u30e9\u30b9\u3092\u62e1\u5f35\u3057\u3066\u30e1\u30bd\u30c3\u30c9\u3092\u5b9f\u88c5\u3059\u308b\u3053\u3068\u3067\u4f5c\u6210\u3055\u308c\u307e\u3059\u3002\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3059\u308b\u3053\u3068\u3067\u3001\u7279\u5b9a\u306e\u30c7\u30fc\u30bf \u30bd\u30fc\u30b9\u3068\u306e\u7d71\u5408\u3001\u30ab\u30b9\u30bf\u30e0 \u30a2\u30eb\u30b4\u30ea\u30ba\u30e0\u306e\u5b9f\u884c\u306a\u3069\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3092\u6e80\u305f\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3059\u308b\u305f\u3081\u306e\u57fa\u672c\u7684\u306a\u624b\u9806\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f5c\u6210\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u6700\u521d\u306b\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u306e\u30b3\u30fc\u30c9\u3092\u683c\u7d0d\u3059\u308b\u305f\u3081\u306b Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f5c\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u65b0\u3057\u3044 Python \u30d5\u30a1\u30a4\u30eb\u306f\u3001Airflow \u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306e\u4e0b\u306e<code>dags<\/code>\u30c7\u30a3\u30ec\u30af\u30c8\u30ea<code>my_operator.py<\/code>\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u4f9d\u5b58\u95a2\u4fc2\u306e\u30a4\u30f3\u30dd\u30fc\u30c8<\/li>\n<\/ol>\n\n\n\n<p>Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3067\u306f\u3001<code>BaseOperator<\/code>\u30af\u30e9\u30b9\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">javascript\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>from airflow.models.baseoperator import BaseOperator\nfrom airflow.utils.decorators import apply_defaults\n<\/code><\/pre>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30ab\u30b9\u30bf\u30e0 Operator \u30af\u30e9\u30b9\u3092\u4f5c\u6210\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p><code>BaseOperator<\/code>\u30af\u30e9\u30b9\u304b\u3089\u7d99\u627f\u3057\u3066\u30e1\u30bd\u30c3\u30c9\u3092\u5b9f\u88c5\u3059\u308b\u3053\u3068\u306b\u3088\u308a\u3001<code>execute()<\/code>\u30ab\u30b9\u30bf\u30e0 Operator \u30af\u30e9\u30b9\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u30ab\u30b9\u30bf\u30e0 Operator \u30af\u30e9\u30b9\u3067\u306f\u3001\u3044\u304f\u3064\u304b\u306e\u8ffd\u52a0\u306e\u30d7\u30ed\u30d1\u30c6\u30a3\u3068\u30e1\u30bd\u30c3\u30c9\u3092\u8ffd\u52a0\u3057\u3066\u3001\u7279\u5b9a\u306e\u6a5f\u80fd\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">ruby\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>class MyOperator(BaseOperator):\n    @apply_defaults\n    def __init__(self, my_arg, *args, **kwargs):\n        super(MyOperator, self).__init__(*args, **kwargs)\n        self.my_arg = my_arg\n\n    def execute(self, context):\n        # \u81ea\u5b9a\u4e49\u903b\u8f91\n        pass\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001<code>MyOperator<\/code>class \u306f<code>BaseOperator<\/code>class\u3001<code>__init__()<\/code>\u4f59\u5206\u306a\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u304c method \u306b\u8ffd\u52a0\u3055\u308c<code>my_arg<\/code>\u3001\u30c7\u30d5\u30a9\u30eb\u30c8\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306f<code>@apply_defaults<\/code>decorator\u3002<code>execute()<\/code>\u30e1\u30bd\u30c3\u30c9\u3067\u306f\u3001\u30ab\u30b9\u30bf\u30e0 \u30ed\u30b8\u30c3\u30af\u3092\u8ffd\u52a0\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>DAG \u30d5\u30a1\u30a4\u30eb\u3092\u69cb\u6210\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001\u30ab\u30b9\u30bf\u30e0 \u30aa\u30da\u30ec\u30fc\u30bf\u306f<code>PythonOperator<\/code>class\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">java\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>from my_operator import MyOperator\n\nmy_task = MyOperator(\n    task_id='my_task',\n    my_arg='my_value',\n    dag=dag\n)\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f<code>MyOperator<\/code>\u3001<code>my_task<\/code>\u3068\u3044\u3046\u540d\u524d\u306e\u30bf\u30b9\u30af\u304c\u30af\u30e9\u30b9\u3067\u4f5c\u6210\u3055\u308c\u3001\u8ffd\u52a0\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u304c\u6e21\u3055\u308c\u307e\u3059<code>my_arg<\/code>\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001\u4ed6\u306e Operator \u3068\u540c\u69d8\u306b\u3001\u3053\u306e\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3084\u305d\u306e\u4ed6\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3059\u308b\u3053\u3068\u3067\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3092\u6e80\u305f\u3057\u3001Airflow \u306e\u6a5f\u80fd\u3068\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u3092\u5f37\u5316\u3067\u304d\u307e\u3059\u3002\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3059\u308b\u3068\u304d\u306f\u3001Airflow \u306e\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0 \u30d1\u30bf\u30fc\u30f3\u3068\u4ed5\u69d8\u306b\u5f93\u3063\u3066\u3001\u30b3\u30fc\u30c9\u306e\u8aad\u307f\u3084\u3059\u3055\u3068\u4fdd\u5b88\u6027\u3092\u78ba\u4fdd\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 Operator \u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 \u30ab\u30b9\u30bf\u30e0 Operator \u3092 Airflow \u306b\u8ffd\u52a0\u3059\u308b<\/p>\n\n\n\n<p>\u30ab\u30b9\u30bf\u30e0 Operator \u3092 Airflow \u306b\u8ffd\u52a0\u3059\u308b\u306b\u306f\u3001\u6b21\u306e\u624b\u9806\u304c\u5fc5\u8981\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u4f5c\u6210<\/li>\n<\/ol>\n\n\n\n<p>\u307e\u305a\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u306e\u30b3\u30fc\u30c9\u3092\u683c\u7d0d\u3059\u308b\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u4f5c\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u30d7\u30e9\u30b0\u30a4\u30f3\u306f\u3001Airflow \u306e\u95a2\u9023\u3059\u308b Operator\u3001Sensor\u3001Hook\u3001Macro \u306a\u3069\u306e\u30b3\u30ec\u30af\u30b7\u30e7\u30f3\u3067\u3059\u3002\u65b0\u3057\u3044 Python \u30e2\u30b8\u30e5\u30fc\u30eb\u306f\u3001Airflow \u30a4\u30f3\u30b9\u30c8\u30fc\u30eb \u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306e\u4e0b\u306e<code>plugins<\/code>\u30c7\u30a3\u30ec\u30af\u30c8\u30ea<code>my_plugin.py<\/code>\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4f5c\u6210\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u30d7\u30e9\u30b0\u30a4\u30f3\u306b\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u8a18\u8ff0\u3057\u307e\u3059\u3002\u5177\u4f53\u7684\u306a\u624b\u9806\u306f\u524d\u306e\u56de\u7b54\u3067\u8aac\u660e\u3057\u305f\u3068\u304a\u308a\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30aa\u30da\u30ec\u30fc\u30bf\u767b\u9332<\/li>\n<\/ol>\n\n\n\n<p><code>AirflowPlugin<\/code>class\u3092\u4ecb\u3057\u3066\u5b9f\u88c5\u3067\u304d\u308b\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u30d7\u30e9\u30b0\u30a4\u30f3\u306b\u767b\u9332\u3057\u307e\u3059\u3002\u4f8b\u3048\u3070\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">arduino\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>from airflow.plugins_manager import AirflowPlugin\n\nclass MyPlugin(AirflowPlugin):\n    name = 'my_plugin'\n    operators = [MyOperator]\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f<code>MyPlugin<\/code>\u3001<code>my_plugin<\/code>\u6307\u5b9a\u3055\u308c\u305f\u30d7\u30e9\u30b0\u30a4\u30f3\u304c\u30af\u30e9\u30b9\u3092\u901a\u3058\u3066\u767b\u9332\u3055\u308c\u3001\u30ab\u30b9\u30bf\u30e0 \u30aa\u30da\u30ec\u30fc\u30bf\u304c<code>MyOperator<\/code>\u30d7\u30e9\u30b0\u30a4\u30f3\u306e\u30aa\u30da\u30ec\u30fc\u30bf \u30ea\u30b9\u30c8\u306b\u8ffd\u52a0\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u6709\u52b9\u306b\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u6700\u5f8c\u306b\u3001Airflow \u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u6709\u52b9\u306b\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u30d7\u30e9\u30b0\u30a4\u30f3\u306e\u30ea\u30b9\u30c8\u306f\u3001\u6b21\u306e\u3088\u3046\u306a\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u306e\u30bb\u30af\u30b7\u30e7\u30f3\u306e\u69cb\u6210<code>airflow.cfg<\/code>\u3067\u304d\u307e\u3059\u3002<code>[core]<\/code><code>plugins_folder<\/code><\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">javascript\u30b3\u30fc\u30c9\u3092\u30b3\u30d4\u30fc<code>plugins_folder = \/path\/to\/plugins_folder, \/path\/to\/my_plugin\n<\/code><\/pre>\n\n\n\n<p>\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001<code>\/path\/to\/my_plugin<\/code>\u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u542b\u3080\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u3078\u306e\u30d1\u30b9\u3002<\/p>\n\n\n\n<p>\u4e0a\u8a18\u306e\u624b\u9806\u3092\u5b8c\u4e86\u3059\u308b\u3068\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u4ed6\u306e Operator \u3068\u540c\u69d8\u306b Airflow \u3067\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001Airflow \u306b\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u8ffd\u52a0\u3059\u308b\u306b\u306f\u3001\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u4f5c\u6210\u3057\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u3092\u8a18\u8ff0\u3057\u3001Operator \u3092\u767b\u9332\u3057\u3001\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3067\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u6709\u52b9\u306b\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u624b\u9806\u306b\u3088\u308a\u3001\u30ab\u30b9\u30bf\u30e0 Operator \u3092 Airflow \u306b\u8ffd\u52a0\u3057\u3066\u3001\u7279\u5b9a\u306e\u30d3\u30b8\u30cd\u30b9 \u30cb\u30fc\u30ba\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306e\u30b3\u30fc\u30c9\u69cb\u6210\u3068\u30e2\u30b8\u30e5\u30fc\u30eb\u5316\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u30b3\u30fc\u30c9\u306e\u7de8\u6210\u3068\u30e2\u30b8\u30e5\u30fc\u30eb\u6027\u306f\u3001Airflow \u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306e\u91cd\u8981\u306a\u5074\u9762\u3067\u3059\u3002\u512a\u308c\u305f\u30b3\u30fc\u30c9\u69cb\u6210\u3068\u30e2\u30b8\u30e5\u30fc\u30eb\u6027\u306b\u3088\u308a\u3001Airflow DAG \u30d5\u30a1\u30a4\u30eb\u306e\u7406\u89e3\u3001\u7dad\u6301\u3001\u62e1\u5f35\u304c\u5bb9\u6613\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<p>Airflow DAG \u30d5\u30a1\u30a4\u30eb\u3092\u6574\u7406\u3057\u3066\u30e2\u30b8\u30e5\u30fc\u30eb\u5316\u3059\u308b\u305f\u3081\u306e\u4e00\u822c\u7684\u306a\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af\u3092\u30e2\u30b8\u30e5\u30fc\u30eb\u306b\u5206\u5272<\/li>\n<\/ol>\n\n\n\n<p>\u30bf\u30b9\u30af\u3092\u30e2\u30b8\u30e5\u30fc\u30eb\u306b\u5206\u5272\u3059\u308b\u3068\u3001DAG \u30d5\u30a1\u30a4\u30eb\u306e\u7ba1\u7406\u304c\u5bb9\u6613\u306b\u306a\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u5404\u30bf\u30b9\u30af\u306e\u30b3\u30fc\u30c9\u3092\u4fdd\u6301\u3059\u308b\u305f\u3081\u306b<code>tasks<\/code>\u547c\u3073\u51fa\u3055\u308c\u308b\u3002<code>tasks<\/code>\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u3067\u306f\u3001\u30bf\u30b9\u30af\u3054\u3068\u306b 1 \u3064\u305a\u3064\u3001\u8907\u6570\u306e Python \u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u4f5c\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3092\u4f7f\u7528\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u30cf\u30fc\u30c9\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u3092\u907f\u3051\u308b\u305f\u3081\u306b\u3001DAG \u306e\u5b9a\u6570\u3068\u69cb\u6210\u3092\u500b\u5225\u306e\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u306b\u5165\u308c\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u5404\u30bf\u30b9\u30af\u306e\u69cb\u6210\u3092\u4fdd\u6301\u3059\u308b<code>config.py<\/code>\u540d\u524d\u306e\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001<code>import<\/code>\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068\u5909\u6570\u306e\u4f7f\u7528<\/li>\n<\/ol>\n\n\n\n<p>\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068\u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u52d5\u7684\u306b\u751f\u6210\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067 SQL \u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u3092\u751f\u6210\u3057\u3001\u30cf\u30fc\u30c9\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u3092\u56de\u907f\u3057\u307e\u3059\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068\u5909\u6570\u3092 Airflow \u5909\u6570\u3067\u7ba1\u7406\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u62bd\u8c61\u7684\u306a\u5171\u6709\u30b3\u30fc\u30c9<\/li>\n<\/ol>\n\n\n\n<p>DAG \u5185\u306e\u5171\u6709\u30b3\u30fc\u30c9\u306f\u3001\u500b\u5225\u306e Python \u30e2\u30b8\u30e5\u30fc\u30eb\u306b\u62bd\u8c61\u5316\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u63a5\u7d9a\u3001\u30c7\u30fc\u30bf\u51e6\u7406\u95a2\u6570\u306a\u3069\u306e\u5171\u6709\u30b3\u30fc\u30c9\u3092\u683c\u7d0d\u3059\u308b\u305f\u3081\u306b<code>utils.py<\/code>\u547c\u3073\u51fa\u3055\u308c\u308b\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001<code>import<\/code>\u30b9\u30c6\u30fc\u30c8\u30e1\u30f3\u30c8\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>\u30de\u30af\u30ed\u3068\u95a2\u6570\u306e\u4f7f\u7528<\/li>\n<\/ol>\n\n\n\n<p>\u30de\u30af\u30ed\u3068\u95a2\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001DAG \u30d5\u30a1\u30a4\u30eb\u306e\u30b3\u30fc\u30c9\u3092\u7c21\u7d20\u5316\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u4e00\u822c\u7684\u306b\u4f7f\u7528\u3055\u308c\u308b\u30de\u30af\u30ed\u3068\u95a2\u6570\u3092 DAG \u30d5\u30a1\u30a4\u30eb\u3067\u5b9a\u7fa9\u3059\u308b\u3068\u3001\u30b3\u30fc\u30c9 \u30b5\u30a4\u30ba\u304c\u5c0f\u3055\u304f\u306a\u308a\u3001\u8aad\u307f\u3084\u3059\u3055\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"6\">\n<li>\u4f7f\u7528\u4e0a\u306e\u6ce8\u610f<\/li>\n<\/ol>\n\n\n\n<p>DAG \u30d5\u30a1\u30a4\u30eb\u306b\u30b3\u30e1\u30f3\u30c8\u3092\u8ffd\u52a0\u3059\u308b\u3068\u3001\u30b3\u30fc\u30c9\u306e\u610f\u56f3\u3068\u30bf\u30b9\u30af\u9593\u306e\u95a2\u4fc2\u3092\u660e\u78ba\u306b\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u30b3\u30e1\u30f3\u30c8\u306b\u306f\u3001\u30bf\u30b9\u30af\u306e\u8aac\u660e\u3001\u4f9d\u5b58\u95a2\u4fc2\u3001\u5909\u6570\u3001\u69cb\u6210\u60c5\u5831\u306a\u3069\u3092\u542b\u3081\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001Airflow DAG \u30d5\u30a1\u30a4\u30eb\u306f\u3001\u9069\u5207\u306a\u30b3\u30fc\u30c9\u69cb\u6210\u3068\u30e2\u30b8\u30e5\u30fc\u30eb\u5316\u306b\u3088\u3063\u3066\u3001\u7406\u89e3\u3057\u3084\u3059\u304f\u3001\u7dad\u6301\u3057\u3084\u3059\u304f\u3001\u62e1\u5f35\u3057\u3084\u3059\u304f\u306a\u308a\u307e\u3059\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3092\u6574\u7406\u3057\u3066\u30e2\u30b8\u30e5\u30fc\u30eb\u5316\u3059\u308b\u5834\u5408\u3001\u30bf\u30b9\u30af\u3092\u30e2\u30b8\u30e5\u30fc\u30eb\u306b\u5206\u5272\u3059\u308b\u3001\u69cb\u6210\u30d5\u30a1\u30a4\u30eb\u3092\u4f7f\u7528\u3059\u308b\u3001\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068\u5909\u6570\u3092\u4f7f\u7528\u3059\u308b\u3001\u5171\u6709\u30b3\u30fc\u30c9\u3092\u62bd\u8c61\u5316\u3059\u308b\u3001\u30de\u30af\u30ed\u3068\u95a2\u6570\u3092\u4f7f\u7528\u3059\u308b\u3001\u6ce8\u91c8\u3092\u4f7f\u7528\u3059\u308b\u306a\u3069\u3001\u5f93\u3046\u3079\u304d\u3044\u304f\u3064\u304b\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044 \u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG \u3092\u4f7f\u7528\u3057\u305f Airflow \u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306e\u751f\u6210<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG \u306f\u3001\u30aa\u30f3\u30c7\u30de\u30f3\u30c9\u3067\u30bf\u30b9\u30af\u3092\u751f\u6210\u304a\u3088\u3073\u7ba1\u7406\u3059\u308b\u305f\u3081\u306e\u975e\u5e38\u306b\u5f37\u529b\u3067\u67d4\u8edf\u306a\u624b\u6cd5\u3067\u3059\u3002\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG \u3092\u64cd\u4f5c\u3059\u308b\u305f\u3081\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306e\u4f7f\u7528<\/li>\n<\/ol>\n\n\n\n<p>Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306f\u3001Airflow \u304c\u52d5\u7684\u306b DAG \u3092\u751f\u6210\u3059\u308b\u4e3b\u306a\u65b9\u6cd5\u3067\u3059\u3002DAG \u306e\u540d\u524d\u3001\u8aac\u660e\u3001\u30bf\u30b9\u30af\u3001\u4f9d\u5b58\u95a2\u4fc2\u3001\u30c7\u30d5\u30a9\u30eb\u30c8 \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u306a\u3069\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u3092\u4f7f\u7528\u3057\u3066\u751f\u6210\u3067\u304d\u307e\u3059\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30b3\u30fc\u30c9\u3092\u633f\u5165\u3059\u308b<code>{% ... %}<\/code>\u305f\u3081\u306b<code>{% for i in range(10) %}<\/code>\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30d1\u30e9\u30e1\u30fc\u30bf\u5316\u3055\u308c\u305f DAG \u306e\u4f7f\u7528<\/li>\n<\/ol>\n\n\n\n<p>\u30d1\u30e9\u30e1\u30fc\u30bf\u5316\u3055\u308c\u305f DAG \u306b\u3088\u308a\u3001DAG \u306e\u751f\u6210\u304c\u3088\u308a\u67d4\u8edf\u306b\u306a\u308a\u307e\u3059\u3002Airflow \u5909\u6570\u3092\u4f7f\u7528\u3057\u3066\u3001\u65e5\u4ed8\u7bc4\u56f2\u3001\u30c7\u30fc\u30bf\u30bd\u30fc\u30b9\u540d\u3001\u30c6\u30fc\u30d6\u30eb\u540d\u306a\u3069\u306e DAG \u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u4fdd\u5b58\u3067\u304d\u307e\u3059\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u3068 Airflow \u5909\u6570\u3092\u4ecb\u3057\u3066 DAG \u3092\u52d5\u7684\u306b\u751f\u6210\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30b3\u30fc\u30c9\u306e\u91cd\u8907\u3092\u907f\u3051\u308b<\/li>\n<\/ol>\n\n\n\n<p>DAG \u3092\u52d5\u7684\u306b\u751f\u6210\u3059\u308b\u3068\u304d\u306f\u3001\u30b3\u30fc\u30c9\u306e\u91cd\u8907\u3092\u907f\u3051\u308b\u3088\u3046\u306b\u6ce8\u610f\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u5171\u6709\u30b3\u30fc\u30c9\u306f\u3001\u500b\u5225\u306e\u95a2\u6570\u307e\u305f\u306f\u30af\u30e9\u30b9\u306b\u62bd\u51fa\u3057\u3066\u3001\u5fc5\u8981\u306b\u5fdc\u3058\u3066\u547c\u3073\u51fa\u3059\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u30b3\u30fc\u30c9\u306e\u91cd\u8907\u304c\u6e1b\u308a\u3001DAG \u306e\u751f\u6210\u304c\u3088\u308a\u30b7\u30f3\u30d7\u30eb\u306b\u306a\u308a\u3001\u4fdd\u5b88\u3057\u3084\u3059\u304f\u306a\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u30c7\u30d0\u30c3\u30b0 \u30c4\u30fc\u30eb\u3092\u4f7f\u7528\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>DAG \u3092\u52d5\u7684\u306b\u751f\u6210\u3059\u308b\u3068\u3001\u69cb\u6587\u30a8\u30e9\u30fc\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc \u30a8\u30e9\u30fc\u3001\u8ad6\u7406\u30a8\u30e9\u30fc\u306a\u3069\u306e\u554f\u984c\u304c\u767a\u751f\u3059\u308b\u5834\u5408\u304c\u3042\u308a\u307e\u3059\u3002DAG \u306e\u30c7\u30d0\u30c3\u30b0\u306b\u5f79\u7acb\u3064\u30c7\u30d0\u30c3\u30b0 \u30c4\u30fc\u30eb\u304c\u7528\u610f\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001<code>airflow test<\/code>\u3053\u306e\u30b3\u30de\u30f3\u30c9\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>DAG \u306e\u8996\u899a\u5316\u3092\u78ba\u8a8d\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>DAG \u304c\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f\u5f8c\u3001DAG \u306e\u8996\u899a\u5316\u3092\u30c1\u30a7\u30c3\u30af\u3057\u3066\u3001DAG \u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30bf\u30b9\u30af\u304c\u6b63\u3057\u304f\u8a2d\u5b9a\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3067\u304d\u307e\u3059\u3002Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u4f7f\u7528\u3057\u3066\u3001DAG \u306e\u8996\u899a\u5316\u3092\u8868\u793a\u3057\u3001\u30bf\u30b9\u30af\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3084\u5b9f\u884c\u6642\u9593\u306a\u3069\u306e\u60c5\u5831\u3092\u78ba\u8a8d\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG \u3092\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3\u306e\u4f7f\u7528\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u5316\u3055\u308c\u305f DAG \u306e\u4f7f\u7528\u3001\u30b3\u30fc\u30c9\u306e\u91cd\u8907\u306e\u56de\u907f\u3001\u30c7\u30d0\u30c3\u30b0 \u30c4\u30fc\u30eb\u306e\u4f7f\u7528\u3001DAG \u30d3\u30b8\u30e5\u30a2\u30e9\u30a4\u30bc\u30fc\u30b7\u30e7\u30f3\u306e\u691c\u67fb\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u5f93\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u3088\u308a\u3001\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG \u3092\u3088\u308a\u67d4\u8edf\u306b\u3001\u4fdd\u5b88\u3057\u3084\u3059\u304f\u3001\u62e1\u5f35\u3057\u3084\u3059\u304f\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u751f\u6210\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u6226\u7565\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u306f\u3001\u30bf\u30b9\u30af\u306e\u5931\u6557\u3084\u4f8b\u5916\u306b\u5bfe\u51e6\u3059\u308b\u306e\u306b\u5f79\u7acb\u3064\u975e\u5e38\u306b\u91cd\u8981\u306a\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u6226\u7565\u3067\u4f7f\u7528\u3067\u304d\u308b\u3044\u304f\u3064\u304b\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u3092\u6709\u52b9\u306b\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>DAG \u30d5\u30a1\u30a4\u30eb\u3067\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u6709\u52b9\u306b\u3057\u3001\u518d\u8a66\u884c\u56de\u6570\u3068\u518d\u8a66\u884c\u9593\u9694\u3092\u8a2d\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u30c7\u30d5\u30a9\u30eb\u30c8\u3067\u306f\u3001\u30b8\u30e7\u30d6\u304c\u5931\u6557\u3059\u308b\u3068\u3001Airflow \u306f 3 \u56de\u306e\u518d\u8a66\u884c\u3092\u8a66\u884c\u3057\u307e\u3059\u3002\u518d\u8a66\u884c\u306e\u9593\u9694\u306f 5 \u5206\u3067\u3059\u3002\u518d\u8a66\u884c\u56de\u6570\u3068\u518d\u8a66\u884c\u9593\u9694\u306f\u3001DAG \u306e \u30d1\u30e9\u30e1\u30fc\u30bf<code>retries<\/code>\u3068\u3002<code>retry_delay<\/code><\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u4f7f\u7528 backoff \u7b56\u7565<\/li>\n<\/ol>\n\n\n\n<p>\u30d0\u30c3\u30af\u30aa\u30d5\u6226\u7565\u306b\u3088\u308a\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u304c\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u52b9\u7387\u7684\u306b\u306a\u308a\u307e\u3059\u3002\u30d0\u30c3\u30af\u30aa\u30d5\u6226\u7565\u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u9593\u306e\u6642\u9593\u9593\u9694\u306f\u3001\u518d\u8a66\u884c\u306e\u56de\u6570\u3068\u3068\u3082\u306b\u5897\u52a0\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u30011 \u56de\u76ee\u306e\u518d\u8a66\u884c\u3067 1 \u5206\u9593\u30012 \u56de\u76ee\u306e\u518d\u8a66\u884c\u3067 2 \u5206\u9593\u30013 \u56de\u76ee\u306e\u518d\u8a66\u884c\u3067 4 \u5206\u9593\u3068\u3044\u3046\u3088\u3046\u306b\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u7121\u9650\u306e\u518d\u8a66\u884c\u3092\u907f\u3051\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u30bf\u30b9\u30af\u304c\u5931\u6557\u3057\u305f\u5834\u5408\u3001\u7121\u9650\u306e\u518d\u8a66\u884c\u306f\u907f\u3051\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u518d\u8a66\u884c\u306e\u6700\u5927\u56de\u6570\u3068\u6700\u5927\u518d\u8a66\u884c\u6642\u9593\u3092\u8a2d\u5b9a\u3057\u3066\u3001\u30bf\u30b9\u30af\u304c\u7121\u9650\u306b\u518d\u8a66\u884c\u3055\u308c\u308b\u306e\u3092\u9632\u3050\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f<code>max_retry<\/code>\u3001<code>retry_exponential_backoff<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u306e\u6700\u5927\u56de\u6570\u3068\u6642\u9593\u3092\u5236\u5fa1\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u30bf\u30b9\u30af\u5931\u6557\u306e\u3057\u304d\u3044\u5024\u3092\u8a2d\u5b9a\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u30bf\u30b9\u30af\u304c\u5931\u6557\u3057\u305f\u3068\u304d\u306b\u30a2\u30e9\u30fc\u30c8\u307e\u305f\u306f\u901a\u77e5\u3092\u30c8\u30ea\u30ac\u30fc\u3059\u308b\u3088\u3046\u306b\u3057\u304d\u3044\u5024\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u56de\u6570\u304c 3 \u56de\u3092\u8d85\u3048\u305f\u3068\u304d\u306b\u30c8\u30ea\u30ac\u30fc\u3055\u308c\u308b\u3088\u3046\u306b\u30a2\u30e9\u30fc\u30e0\u3092\u8a2d\u5b9a\u3057\u3066\u3001\u6642\u9593\u5185\u306b\u30bf\u30b9\u30af\u306e\u554f\u984c\u3092\u691c\u51fa\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>\u88dc\u511f\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>\u30bf\u30b9\u30af\u304c\u5931\u6557\u3057\u305f\u5834\u5408\u3001\u88dc\u6b63\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u3092\u518d\u958b\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u88dc\u6b63\u95a2\u6570\u3092\u30bf\u30b9\u30af\u3067\u4f7f\u7528\u3057\u3066\u3001\u30bf\u30b9\u30af\u3092\u30ed\u30fc\u30eb\u30d0\u30c3\u30af\u3057\u3001\u4e2d\u9593\u72b6\u614b\u3092\u30af\u30ea\u30fc\u30f3\u30a2\u30c3\u30d7\u3067\u304d\u307e\u3059\u3002DAG \u30d5\u30a1\u30a4\u30eb\u3067\u306f\u3001<code>on_failure_callback<\/code>\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3002<\/p>\n\n\n\n<p>\u3064\u307e\u308a\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u6226\u7565\u3067\u306f\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u3092\u6709\u52b9\u306b\u3059\u308b\u3001\u30d0\u30c3\u30af\u30aa\u30d5\u6226\u7565\u3092\u4f7f\u7528\u3059\u308b\u3001\u7121\u9650\u306e\u518d\u8a66\u884c\u3092\u56de\u907f\u3059\u308b\u3001\u30bf\u30b9\u30af\u5931\u6557\u306e\u3057\u304d\u3044\u5024\u3092\u8a2d\u5b9a\u3059\u308b\u3001\u88dc\u511f\u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u4f7f\u7528\u3059\u308b\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u5f93\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u4f7f\u7528\u3059\u308b\u3068\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u3092\u3088\u308a\u30b9\u30de\u30fc\u30c8\u306b\u3001\u3088\u308a\u52b9\u7387\u7684\u306b\u3001\u3088\u308a\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u3082\u306e\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306e\u9ad8\u53ef\u7528\u6027\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3067\u306f\u3001\u9ad8\u53ef\u7528\u6027\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u306f\u3001Airflow \u30b5\u30fc\u30d3\u30b9\u306e\u4fe1\u983c\u6027\u3068\u5b89\u5b9a\u6027\u3092\u7dad\u6301\u3059\u308b\u306e\u306b\u5f79\u7acb\u3064\u975e\u5e38\u306b\u91cd\u8981\u306a\u30e1\u30ab\u30cb\u30ba\u30e0\u3067\u3059\u3002\u9ad8\u53ef\u7528\u6027\u3068\u30d5\u30a7\u30fc\u30eb\u30aa\u30fc\u30d0\u30fc\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Airflow \u30af\u30e9\u30b9\u30bf\u306e\u4f7f\u7528<\/li>\n<\/ol>\n\n\n\n<p>\u672c\u756a\u74b0\u5883\u3067\u306f\u3001\u53ef\u7528\u6027\u3068\u30d5\u30a9\u30fc\u30eb\u30c8 \u30c8\u30ec\u30e9\u30f3\u30b9\u3092\u5411\u4e0a\u3055\u305b\u308b\u305f\u3081\u306b Airflow \u30af\u30e9\u30b9\u30bf\u3092\u4f7f\u7528\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002Airflow \u30af\u30e9\u30b9\u30bf\u3067\u306f\u3001\u8907\u6570\u306e Airflow \u30ce\u30fc\u30c9\u304c\u540c\u3058 DAG \u3092\u5b9f\u884c\u3057\u3001\u8ca0\u8377\u5206\u6563\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u7528\u306e\u30ed\u30fc\u30c9 \u30d0\u30e9\u30f3\u30b5\u30fc\u3092\u4f7f\u7528\u3067\u304d\u307e\u3059\u3002\u30ce\u30fc\u30c9\u306b\u969c\u5bb3\u304c\u767a\u751f\u3057\u305f\u5834\u5408\u3001\u30ed\u30fc\u30c9 \u30d0\u30e9\u30f3\u30b5\u30fc\u306f\u81ea\u52d5\u7684\u306b\u30ea\u30af\u30a8\u30b9\u30c8\u3092\u4ed6\u306e\u30ce\u30fc\u30c9\u306b\u8ee2\u9001\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\">\n<li>\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u5fa9\u5143<\/li>\n<\/ol>\n\n\n\n<p>\u30e1\u30bf\u30d9\u30fc\u30b9\u306f\u3001\u30bf\u30b9\u30af\u3068 DAG \u306e\u30e1\u30bf\u30c7\u30fc\u30bf\u3092\u4fdd\u6301\u3059\u308b Airflow \u306e\u91cd\u8981\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u3059\u3002\u904b\u7528\u74b0\u5883\u3067\u306f\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u5b9a\u671f\u7684\u306b\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3057\u3001\u8907\u6570\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3092\u4fdd\u6301\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u969c\u5bb3\u3084\u30c7\u30fc\u30bf\u306e\u7834\u640d\u304c\u767a\u751f\u3057\u305f\u5834\u5408\u306f\u3001\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3092\u5fa9\u5143\u3059\u308b\u3053\u3068\u3067\u30e1\u30bf\u30d9\u30fc\u30b9\u3092\u5fa9\u5143\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\">\n<li>\u30aa\u30d5\u30b5\u30a4\u30c8 \u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3092\u4f7f\u7528\u3059\u308b<\/li>\n<\/ol>\n\n\n\n<p>Airflow \u30af\u30e9\u30b9\u30bf\u3067\u306f\u3001\u81ea\u7136\u707d\u5bb3\u3084\u5730\u57df\u7684\u306a\u969c\u5bb3\u304c\u767a\u751f\u3057\u305f\u5834\u5408\u306b\u5fa9\u65e7\u3067\u304d\u308b\u3088\u3046\u306b\u3001\u30d0\u30c3\u30af\u30a2\u30c3\u30d7 \u30c7\u30fc\u30bf\u3092\u5730\u7406\u7684\u306b\u7570\u306a\u308b\u5834\u6240\u306b\u4fdd\u5b58\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u30d0\u30c3\u30af\u30a2\u30c3\u30d7 \u30c7\u30fc\u30bf\u3092\u30af\u30e9\u30a6\u30c9 \u30b9\u30c8\u30ec\u30fc\u30b8 \u30b5\u30fc\u30d3\u30b9\u306b\u4fdd\u5b58\u3057\u3001\u8907\u6570\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u5834\u6240\u3068\u8907\u6570\u306e\u30a2\u30ab\u30a6\u30f3\u30c8\u3092\u8a2d\u5b9a\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"4\">\n<li>\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3068\u30a2\u30e9\u30fc\u30c8<\/li>\n<\/ol>\n\n\n\n<p>\u672c\u756a\u74b0\u5883\u3067\u306f\u3001Airflow \u30b5\u30fc\u30d3\u30b9\u306e\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u3067\u76e3\u8996\u3057\u3001\u30a2\u30e9\u30fc\u30e0 \u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u8a2d\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Prometheus \u3084 Grafana \u306a\u3069\u306e\u76e3\u8996\u30c4\u30fc\u30eb\u3092\u4f7f\u7528\u3057\u3066 Airflow \u306e\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u76e3\u8996\u3057\u3001\u30a2\u30e9\u30fc\u30e0 \u30eb\u30fc\u30eb\u3092\u8a2d\u5b9a\u3057\u3066\u554f\u984c\u3092\u9069\u6642\u306b\u691c\u51fa\u3057\u3066\u89e3\u6c7a\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"5\">\n<li>\u4f7f\u7528\u5bb9\u5668\u5316\u90e8\u7f72<\/li>\n<\/ol>\n\n\n\n<p>\u30b3\u30f3\u30c6\u30ca\u5316\u3055\u308c\u305f\u30c7\u30d7\u30ed\u30a4\u306b\u3088\u308a\u3001Airflow \u30c7\u30d7\u30ed\u30a4\u306e\u67d4\u8edf\u6027\u3068\u4fe1\u983c\u6027\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Docker \u3084 Kubernetes \u306a\u3069\u306e\u30b3\u30f3\u30c6\u30ca\u5316\u30c6\u30af\u30ce\u30ed\u30b8\u3092\u4f7f\u7528\u3057\u3066 Airflow \u3092\u30c7\u30d7\u30ed\u30a4\u3057\u3001\u8fc5\u901f\u306a\u30b9\u30b1\u30fc\u30ea\u30f3\u30b0\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u3092\u5b9f\u73fe\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u8981\u7d04\u3059\u308b\u3068\u3001\u9ad8\u53ef\u7528\u6027\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u306b\u95a2\u3057\u3066\u306f\u3001Airflow \u30af\u30e9\u30b9\u30bf\u30fc\u306e\u4f7f\u7528\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u5fa9\u5143\u3001\u30aa\u30d5\u30b5\u30a4\u30c8 \u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u306e\u4f7f\u7528\u3001\u76e3\u8996\u3068\u30a2\u30e9\u30fc\u30c8\u3001\u30b3\u30f3\u30c6\u30ca\u30fc\u5316\u3055\u308c\u305f\u30c7\u30d7\u30ed\u30a4\u306e\u4f7f\u7528\u306a\u3069\u3001\u3044\u304f\u3064\u304b\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u5f93\u3046\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002\u3053\u308c\u3089\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u3088\u308a\u3001Airflow \u30b5\u30fc\u30d3\u30b9\u306e\u4fe1\u983c\u6027\u3068\u5b89\u5b9a\u6027\u3092\u9ad8\u3081\u3001\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u306e\u6a5f\u80fd\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u5fa9\u7fd2\u30b3\u30fc\u30b9\u306e\u5185\u5bb9\u3092\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>\u3053\u306e\u30b3\u30fc\u30b9\u3067\u306f\u3001\u4e3b\u306b Airflow \u306e\u57fa\u672c\u7684\u306a\u77e5\u8b58\u3001\u4e00\u822c\u7684\u306a\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3001\u304a\u3088\u3073\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002\u4ee5\u4e0b\u306f\u3001\u3053\u306e\u30b3\u30fc\u30b9\u306e\u4e3b\u306a\u5185\u5bb9\u306e\u30ec\u30d3\u30e5\u30fc\u3067\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Airflow \u306e\u7d39\u4ecb: Airflow \u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3001\u6a5f\u80fd\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 \u30b7\u30ca\u30ea\u30aa\u3001\u304a\u3088\u3073 Airflow \u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u69cb\u6210\u306e\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>DAG\u3001Task\u3001Operator\u3001TaskInstance \u306a\u3069\u306e\u57fa\u672c\u6982\u5ff5: \u3053\u308c\u3089\u306e\u6982\u5ff5\u306e\u610f\u5473\u3001\u6a5f\u80fd\u3001\u304a\u3088\u3073\u4f7f\u7528\u6cd5\u3092\u8a73\u7d30\u306b\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9: Airflow \u306b\u304a\u3051\u308b\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u306e\u5f79\u5272\u3068\u9055\u3044\u3001\u304a\u3088\u3073 LocalExecutor \u3084 CeleryExecutor \u306a\u3069\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u306e\u4f7f\u7528\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3068\u30c8\u30ea\u30ac\u30fc: \u30bf\u30b9\u30af\u9593\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8a2d\u5b9a\u3059\u308b\u65b9\u6cd5\u3001\u304a\u3088\u3073\u30c8\u30ea\u30ac\u30fc \u30eb\u30fc\u30eb\u3084\u5916\u90e8\u30bf\u30b9\u30af \u30bb\u30f3\u30b5\u30fc\u306a\u3069\u306e\u6a5f\u80fd\u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u5909\u6570\u3068\u63a5\u7d9a\u306e\u7ba1\u7406: Airflow \u5909\u6570\u3068\u63a5\u7d9a\u3092\u4f7f\u7528\u3057\u3066\u69cb\u6210\u60c5\u5831\u3092\u7ba1\u7406\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>XComs\uff08\u30bf\u30b9\u30af\u9593\u901a\u4fe1\uff09\uff1aAirflow\u306b\u304a\u3051\u308bXCom\u306e\u5f79\u5272\u3068\u4f7f\u3044\u65b9\u3092\u8a73\u3057\u304f\u89e3\u8aac\u3002<\/li>\n\n\n\n<li>\u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3068 Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8 \u30a8\u30f3\u30b8\u30f3: \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3057\u3066\u30bf\u30b9\u30af \u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3092\u52d5\u7684\u306b\u751f\u6210\u3057\u3001\u30bf\u30b9\u30af\u5b9a\u7fa9\u3067 Jinja \u30c6\u30f3\u30d7\u30ec\u30fc\u30c8\u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3068\u30ed\u30ae\u30f3\u30b0: Airflow \u30a6\u30a7\u30d6 \u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u4f7f\u7528\u3057\u3066\u30b8\u30e7\u30d6 \u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u30e2\u30cb\u30bf\u30ea\u30f3\u30b0\u3057\u3001\u30b8\u30e7\u30d6 \u30ed\u30b0\u3092\u8868\u793a\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u9ad8\u53ef\u7528\u6027\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc: Airflow \u30af\u30e9\u30b9\u30bf\u30ea\u30f3\u30b0\u3001\u30e1\u30bf\u30d9\u30fc\u30b9\u306e\u30d0\u30c3\u30af\u30a2\u30c3\u30d7\u3068\u5fa9\u5143\u3001\u30b3\u30f3\u30c6\u30ca\u5316\u3055\u308c\u305f\u30c7\u30d7\u30ed\u30a4\u306e\u4f7f\u7528\u306a\u3069\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u4f7f\u7528\u3057\u3066\u3001Airflow \u306e\u53ef\u7528\u6027\u3068\u8010\u969c\u5bb3\u6027\u3092\u5411\u4e0a\u3055\u305b\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068\u30aa\u30da\u30ec\u30fc\u30bf\u30fc: \u30ab\u30b9\u30bf\u30e0 \u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u3068\u30d7\u30e9\u30b0\u30a4\u30f3\u3092\u4f5c\u6210\u3057\u3001\u305d\u308c\u3089\u3092 Airflow \u306b\u8ffd\u52a0\u3059\u308b\u65b9\u6cd5\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9: \u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u6226\u7565\u3001\u52d5\u7684\u306b\u751f\u6210\u3055\u308c\u305f DAG\u3001\u30bf\u30b9\u30af\u306e\u518d\u8a66\u884c\u3068\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u306a\u3069\u3001Airflow \u306e\u3044\u304f\u3064\u304b\u306e\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306b\u3064\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u3053\u306e\u30b3\u30fc\u30b9\u306e\u5185\u5bb9\u306f\u3001Airflow \u306e\u57fa\u672c\u3068\u9ad8\u5ea6\u306a\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3092\u30ab\u30d0\u30fc\u3057\u3001\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3068\u69cb\u6210\u304b\u3089\u30c7\u30d7\u30ed\u30a4\u3068\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u307e\u3067\u3059\u3079\u3066\u3092\u30ab\u30d0\u30fc\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u306e\u30b3\u30fc\u30b9\u306e\u5b66\u7fd2\u3092\u901a\u3058\u3066\u3001Airflow \u306e\u57fa\u672c\u7684\u306a\u6982\u5ff5\u3001\u4f7f\u7528\u65b9\u6cd5\u3001\u304a\u3088\u3073\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u5305\u62ec\u7684\u306b\u7406\u89e3\u3057\u3001\u7fd2\u5f97\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>Airflow \u306e\u4eca\u5f8c\u306e\u5c55\u958b\u306b\u3064\u3044\u3066\u8a73\u3057\u304f\u8aac\u660e\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n<p>Airflow \u306f\u73fe\u5728\u3001\u6700\u3082\u4eba\u6c17\u306e\u3042\u308b\u30aa\u30fc\u30d7\u30f3 \u30bd\u30fc\u30b9\u306e\u30bf\u30b9\u30af \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u304a\u3088\u3073\u30ef\u30fc\u30af\u30d5\u30ed\u30fc \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30c4\u30fc\u30eb\u306e 1 \u3064\u3067\u3042\u308a\u3001\u591a\u304f\u306e\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba \u30ec\u30d9\u30eb\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 \u30b7\u30ca\u30ea\u30aa\u3067\u5e83\u304f\u4f7f\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002Airflow \u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u3082\u6210\u9577\u3068\u6539\u5584\u3092\u7d9a\u3051\u3066\u3044\u307e\u3059. Airflow \u306e\u5c06\u6765\u306e\u958b\u767a\u306b\u95a2\u3059\u308b\u3044\u304f\u3064\u304b\u306e\u50be\u5411\u3068\u4e88\u6e2c\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u3088\u308a\u30b9\u30de\u30fc\u30c8\u3067\u81ea\u52d5\u5316\u3055\u308c\u305f: Airflow \u306e\u672a\u6765\u306f\u3001\u3088\u308a\u30b9\u30de\u30fc\u30c8\u3067\u81ea\u52d5\u5316\u3055\u308c\u308b\u3053\u3068\u3067\u3059\u3002\u305f\u3068\u3048\u3070\u3001\u6a5f\u68b0\u5b66\u7fd2\u3084\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u306a\u3069\u306e\u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u306b\u3088\u308a\u3001Airflow \u306f DAG \u3092\u3088\u308a\u81ea\u52d5\u7684\u306b\u751f\u6210\u3057\u3001\u30bf\u30b9\u30af \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u6700\u9069\u5316\u3057\u3001\u5b9f\u884c\u52b9\u7387\u3092\u5411\u4e0a\u3055\u305b\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u5206\u6563\u6027\u3068\u53ef\u7528\u6027\u306e\u5411\u4e0a: Airflow \u306f\u3001\u5927\u898f\u6a21\u306a\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 \u30b7\u30ca\u30ea\u30aa\u306e\u30cb\u30fc\u30ba\u3092\u6e80\u305f\u3059\u305f\u3081\u306b\u3001\u5c06\u6765\u7684\u306b\u5206\u6563\u6027\u3068\u53ef\u7528\u6027\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u306f\u3001\u3088\u308a\u591a\u304f\u306e\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc\u3068\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u30fc\u306e\u30aa\u30d7\u30b7\u30e7\u30f3\u3001\u304a\u3088\u3073\u3088\u308a\u4fe1\u983c\u6027\u306e\u9ad8\u3044\u30d5\u30a7\u30a4\u30eb\u30aa\u30fc\u30d0\u30fc\u3068\u30d5\u30a9\u30fc\u30eb\u30c8 \u30c8\u30ec\u30e9\u30f3\u30b9 \u30e1\u30ab\u30cb\u30ba\u30e0\u3092\u30b5\u30dd\u30fc\u30c8\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u3088\u308a\u30aa\u30fc\u30d7\u30f3\u3067\u62e1\u5f35\u53ef\u80fd: Airflow \u306e\u5c06\u6765\u306f\u3001\u3088\u308a\u591a\u304f\u306e\u30c7\u30fc\u30bf \u30bd\u30fc\u30b9\u3001\u30c4\u30fc\u30eb\u3001\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3092\u30b5\u30dd\u30fc\u30c8\u3059\u308b\u305f\u3081\u306b\u3001\u3088\u308a\u30aa\u30fc\u30d7\u30f3\u3067\u62e1\u5f35\u53ef\u80fd\u306b\u306a\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u306f\u3001\u3088\u308a\u591a\u304f\u306e\u30d7\u30e9\u30b0\u30a4\u30f3\u3068\u7d71\u5408\u3092\u901a\u3058\u3066\u3001Hadoop\u3001Spark\u3001Kubernetes \u306a\u3069\u306e\u3088\u308a\u591a\u304f\u306e\u30c7\u30fc\u30bf \u30bd\u30fc\u30b9\u3068\u30c4\u30fc\u30eb\u3092\u30b5\u30dd\u30fc\u30c8\u3067\u304d\u307e\u3059\u3002<\/li>\n\n\n\n<li>\u4f7f\u3044\u3084\u3059\u3055\u3068\u8996\u899a\u5316: Airflow \u306e\u672a\u6765\u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u30bf\u30b9\u30af\u3068\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u3088\u308a\u8fc5\u901f\u304b\u3064\u4fbf\u5229\u306b\u4f5c\u6210\u304a\u3088\u3073\u7ba1\u7406\u3067\u304d\u308b\u3088\u3046\u306b\u3001\u4f7f\u3044\u3084\u3059\u304f\u8996\u899a\u5316\u3059\u308b\u3053\u3068\u3082\u5bb9\u6613\u306b\u306a\u308a\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Airflow \u306f\u3001\u3088\u308a\u76f4\u611f\u7684\u3067\u4f7f\u3044\u3084\u3059\u3044\u30a4\u30f3\u30bf\u30fc\u30d5\u30a7\u30fc\u30b9\u3092\u901a\u3058\u3066\u3001\u30e6\u30fc\u30b6\u30fc\u304c\u30bf\u30b9\u30af\u306e\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3068\u5b9f\u884c\u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u3088\u308a\u3088\u304f\u7406\u89e3\u3057\u3001\u7ba1\u7406\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/li>\n<\/ol>\n\n\n\n<p>\u4e00\u822c\u306b\u3001\u5c06\u6765\u306e Airflow \u306f\u3001\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba \u30ec\u30d9\u30eb\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u306e\u7d76\u3048\u9593\u306a\u304f\u5909\u5316\u3059\u308b\u30cb\u30fc\u30ba\u3092\u6e80\u305f\u3059\u305f\u3081\u306b\u3001\u3088\u308a\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30c8\u3067\u3001\u5206\u6563\u578b\u3067\u3001\u30aa\u30fc\u30d7\u30f3\u3067\u4f7f\u3044\u3084\u3059\u3044\u30bf\u30b9\u30af \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u304a\u3088\u3073\u30ef\u30fc\u30af\u30d5\u30ed\u30fc \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u3092\u63d0\u4f9b\u3057\u7d9a\u3051\u307e\u3059\u3002\u540c\u6642\u306b\u3001Airflow \u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u306f\u5f15\u304d\u7d9a\u304d\u958b\u767a\u3068\u6210\u9577\u3092\u7d9a\u3051\u3001Airflow \u306e\u958b\u767a\u3068\u30a4\u30ce\u30d9\u30fc\u30b7\u30e7\u30f3\u3092\u63a8\u9032\u3057\u3066\u3044\u304d\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/edu.ujhb.org\/?p=1736\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/chat.openai.com\/_next\/image?url=https%3A%2F%2Flh3.googleusercontent.com%2Fa%2FAGNmyxbwVdnTP0E2eBqDrujRQjV-wFP12Thr4vFgysVv5A%3Ds96-c&amp;w=96&amp;q=75\" alt=\"gun tei\"\/><\/figure>\n\n\n\n<p>\u95a2\u9023\u3059\u308b\u5b66\u7fd2\u30ea\u30bd\u30fc\u30b9\u3068\u9ad8\u5ea6\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u306e\u63a8\u5968\u4e8b\u9805\u3092\u63d0\u4f9b\u3057\u3066\u304f\u3060\u3055\u3044<\/p>\n\n\n\n<p>Airflow \u3092\u5b66\u7fd2\u3059\u308b\u305f\u3081\u306e\u95a2\u9023\u30ea\u30bd\u30fc\u30b9\u3068\u9ad8\u5ea6\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u306e\u63a8\u5968\u4e8b\u9805\u3092\u6b21\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Airflow \u306e\u516c\u5f0f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8: Airflow \u306e\u516c\u5f0f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306b\u306f\u3001\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3001\u69cb\u6210\u3001\u4f7f\u7528\u3001\u62e1\u5f35\u306a\u3069\u3001\u8a73\u7d30\u306a\u7d39\u4ecb\u3068\u4f7f\u7528\u30ac\u30a4\u30c9\u30e9\u30a4\u30f3\u304c\u8a18\u8f09\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u516c\u5f0f Web \u30b5\u30a4\u30c8 (https:\/\/airflow.apache.org\/docs) \u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u3059<a href=\"https:\/\/airflow.apache.org\/docs%E3%80%82\">\u3002<\/a><\/li>\n\n\n\n<li>Airflow 101 \u30d3\u30c7\u30aa \u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb: \u3053\u308c\u306f\u3001Airflow \u306e\u57fa\u672c\u3068\u4f7f\u7528\u6cd5\u3092\u7d39\u4ecb\u3059\u308b\u4e00\u9023\u306e\u516c\u5f0f\u30d3\u30c7\u30aa \u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u3067\u3059\u3002https:\/\/www.youtube.com\/playlist?list=PLF3s2WICJlqOiymMaTLjwwHz-MSVbtJPQ\u3067\u5165\u624b\u3067\u304d\u307e\u3059<a href=\"https:\/\/www.youtube.com\/playlist?list=PLF3s2WICJlqOiymMaTLjwwHz-MSVbtJPQ%E3%80%82\">\u3002<\/a><\/li>\n\n\n\n<li>Airflow \u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb \u30d6\u30ed\u30b0 \u30b7\u30ea\u30fc\u30ba: \u3053\u308c\u306f\u3001Astronomer \u306e Derek Chen-Becker \u306b\u3088\u308b Airflow \u306b\u95a2\u3059\u308b\u4e00\u9023\u306e\u30d6\u30ed\u30b0\u6295\u7a3f\u3067\u3059\u3002\u3053\u306e\u30d6\u30ed\u30b0\u3067\u306f\u3001\u57fa\u672c\u3001\u9ad8\u5ea6\u306a\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u3001\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u306a\u3069\u3001Airflow \u306e\u3042\u3089\u3086\u308b\u5074\u9762\u3092\u53d6\u308a\u4e0a\u3052\u3066\u3044\u307e\u3059\u3002https:\/\/www.astronomer.io\/guides\/\u3067\u5165\u624b\u3067\u304d\u307e\u3059<a href=\"https:\/\/www.astronomer.io\/guides\/%E3%80%82\">\u3002<\/a><\/li>\n\n\n\n<li>Airflow Summit \u30d3\u30c7\u30aa: Airflow Summit \u306f\u3001Airflow \u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u306e\u5e74\u6b21\u4f1a\u8b70\u3067\u3042\u308a\u3001\u6700\u65b0\u306e Airflow \u30c6\u30af\u30ce\u30ed\u30b8\u3068\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 \u30b1\u30fc\u30b9\u304c\u5171\u6709\u3055\u308c\u307e\u3059\u3002\u8ffd\u52a0\u306e\u5b66\u7fd2\u30ea\u30bd\u30fc\u30b9\u3068\u30a4\u30f3\u30b9\u30d4\u30ec\u30fc\u30b7\u30e7\u30f3\u306b\u3064\u3044\u3066\u306f\u3001YouTube \u3067\u4ee5\u524d\u306e\u30bb\u30c3\u30b7\u30e7\u30f3\u306e\u30d3\u30c7\u30aa\u3092\u3054\u89a7\u304f\u3060\u3055\u3044\u3002https:\/\/www.youtube.com\/channel\/UCJ0W6UdQv-9De6UioL6XZpA\u3067\u5165\u624b\u3067\u304d\u307e\u3059<a href=\"https:\/\/www.youtube.com\/channel\/UCJ0W6UdQv-9De6UioL6XZpA%E3%80%82\">\u3002<\/a><\/li>\n\n\n\n<li>Airflow \u30b3\u30df\u30e5\u30cb\u30c6\u30a3: Airflow \u30b3\u30df\u30e5\u30cb\u30c6\u30a3\u306f\u3001Airflow \u306e\u958b\u767a\u8005\u3068\u30e6\u30fc\u30b6\u30fc\u306e\u305f\u3081\u306e\u30b3\u30df\u30e5\u30cb\u30b1\u30fc\u30b7\u30e7\u30f3 \u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3067\u3042\u308a\u3001\u3055\u307e\u3056\u307e\u306a\u554f\u984c\u306e\u89e3\u6c7a\u7b56\u3092\u898b\u3064\u3051\u305f\u308a\u3001\u7d4c\u9a13\u3092\u5171\u6709\u3057\u305f\u308a\u3001\u30d8\u30eb\u30d7\u3092\u5f97\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002https:\/\/github.com\/apache\/airflow\u3067\u5165\u624b\u3067\u304d\u307e\u3059<a href=\"https:\/\/github.com\/apache\/airflow%E3%80%82\">\u3002<\/a><\/li>\n\n\n\n<li>Airflow \u306e\u9ad8\u5ea6\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u3068\u30b1\u30fc\u30b9 \u30b9\u30bf\u30c7\u30a3: \u4e00\u90e8\u306e\u4f01\u696d\u3001\u7d44\u7e54\u3001\u304a\u3088\u3073\u500b\u4eba\u306f\u3001Airflow \u3067\u306e\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 \u30b1\u30fc\u30b9\u3068\u7d4c\u9a13\u3092\u5171\u6709\u3057\u3001\u691c\u7d22\u30a8\u30f3\u30b8\u30f3\u307e\u305f\u306f\u30bd\u30fc\u30b7\u30e3\u30eb \u30e1\u30c7\u30a3\u30a2\u3092\u901a\u3058\u3066\u95a2\u9023\u30ea\u30bd\u30fc\u30b9\u3092\u898b\u3064\u3051\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u3001Lyft \u793e\u306e Airflow \u306b\u95a2\u3059\u308b\u9ad8\u5ea6\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb:&nbsp;<a href=\"https:\/\/eng.lyft.com\/airflow-at-lyft-3c67d28b8d79%E3%80%82\">https:\/\/eng.lyft.com\/airflow-at-lyft-3c67d28b8d79.<\/a><\/li>\n<\/ol>\n\n\n\n<p>\u4e0a\u8a18\u306f\u3001Airflow \u3092\u5b66\u7fd2\u3059\u308b\u305f\u3081\u306e\u4e00\u822c\u7684\u306a\u30ea\u30bd\u30fc\u30b9\u3068\u9ad8\u5ea6\u306a\u30c1\u30e5\u30fc\u30c8\u30ea\u30a2\u30eb\u306e\u63a8\u5968\u4e8b\u9805\u3067\u3042\u308a\u3001\u521d\u5fc3\u8005\u304c Airflow \u306e\u4f7f\u7528\u6cd5\u3068\u30d9\u30b9\u30c8 \u30d7\u30e9\u30af\u30c6\u30a3\u30b9\u3092\u3059\u3070\u3084\u304f\u7fd2\u5f97\u3059\u308b\u306e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>w \u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3068\u3044\u304f\u3064\u304b\u306e\u4e00\u822c\u7684\u306a\u30c1\u30e5 &hellip; <\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_mi_skip_tracking":false,"footnotes":""},"categories":[23],"tags":[],"class_list":["post-2153","post","type-post","status-publish","format-standard","hentry","category-material"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=\/wp\/v2\/posts\/2153","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2153"}],"version-history":[{"count":1,"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=\/wp\/v2\/posts\/2153\/revisions"}],"predecessor-version":[{"id":2154,"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=\/wp\/v2\/posts\/2153\/revisions\/2154"}],"wp:attachment":[{"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2153"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2153"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/edu.ujhb.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}