GCS decompressive transcoding not supported when reading

link管理

链接快照平台

输入网页链接，自动生成快照
标签化管理网页链接

相关文章推荐

爱看球的杨桃 · 籼稻_百度百科· 6 月前 ·

跑龙套的玉米 · 限制级电影《百夫长》揭秘第九军团悬案，罗马最 ...· 7 月前 ·

从未表白的煎饼果子 · 数字孪生与焊接工艺参数优化如何结合- CSDN文库· 1 年前 ·

飞奔的莲藕 · 2024年新《民法典》关于婚后房产的规定？_ ...· 1 年前 ·

豪情万千的双杠 · [环评拟审批意见公示]天津市耀华中学礼堂整修 ...· 2 年前 ·

</noscript><div id="___gatsby"><div style="outline:none" tabindex="-1" id="gatsby-focus-wrapper"><header class="TemplateHeader-module--header--f6398 "><div class="Container-module--largeContainer--94cb8"><div class="TemplateHeader-module--wrapper--8e3ea"><a href="https://www.lightrun.com"><img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMjIwIiBoZWlnaHQ9IjM4IiB2aWV3Qm94PSIwIDAgMjIwIDM4IiBmaWxsPSJub25lIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPgo8cGF0aCBkPSJNMTA2LjE4MSAyLjg3MDI3QzEwNS42MyAyLjg4MzUxIDEwNS4wOTYgMy4wNTczMiAxMDQuNjQ1IDMuMzY5OTRDMTA0LjE5NCAzLjY4MjU1IDEwMy44NDYgNC4xMjAwNiAxMDMuNjQ1IDQuNjI3NjVDMTAzLjQ0NCA1LjEzNTIzIDEwMy4zOTggNS42OTAzMSAxMDMuNTE0IDYuMjIzMzNDMTAzLjYzIDYuNzU2MzYgMTAzLjkwMyA3LjI0MzYxIDEwNC4yOTcgNy42MjQwNUMxMDQuNjkyIDguMDA0NDkgMTA1LjE5MSA4LjI2MTE4IDEwNS43MzIgOC4zNjE5N0MxMDYuMjczIDguNDYyNzYgMTA2LjgzMiA4LjQwMzE2IDEwNy4zMzkgOC4xOTA2NEMxMDcuODQ2IDcuOTc4MTIgMTA4LjI3OCA3LjYyMjEzIDEwOC41ODIgNy4xNjcyN0MxMDguODg1IDYuNzEyNDIgMTA5LjA0NyA2LjE3ODk0IDEwOS4wNDYgNS42MzM2N0MxMDkuMDUgNS4yNjM0MSAxMDguOTc4IDQuODk2MiAxMDguODM0IDQuNTU0MjlDMTA4LjY5IDQuMjEyMzggMTA4LjQ3OCAzLjkwMjg4IDEwOC4yMSAzLjY0NDUzQzEwNy45NDMgMy4zODYxOCAxMDcuNjI1IDMuMTg0MzUgMTA3LjI3NiAzLjA1MTI2QzEwNi45MjcgMi45MTgxOCAxMDYuNTU0IDIuODU2NjEgMTA2LjE4MSAyLjg3MDI3WiIgZmlsbD0iIzFCMUExOSIvPgo8cGF0aCBkPSJNMTA4LjY1MiAxMC4wNTEzSDEwMy43NzFWMjguMzc5OEgxMDguNjUyVjEwLjA1MTNaIiBmaWxsPSIjMUIxQTE5Ii8+CjxwYXRoIGQ9Ik0xMjEuOTkyIDI0LjU2MDhDMTE5LjIzNSAyNC41NjA4IDExNy4yNCAyMi40MjI3IDExNy4yNCAxOS4xODJDMTE3LjI0IDE1Ljk0MTIgMTE5LjE4MSAxMy44NTY5IDEyMS45MzcgMTMuODU2OUMxMjQuODA5IDEzLjg1NjkgMTI2LjY4OSAxNi4wNjIyIDEyNi42ODkgMTkuMTgyQzEyNi42ODkgMjIuNDQyOSAxMjQuNzgyIDI0LjU2MDggMTIxLjkzNyAyNC41NjA4SDEyMS45OTJaTTEyNi44NzMgMTEuOTgxQzEyNi4xOSAxMS4yMDkgMTI1LjM0NCAxMC41OTUgMTI0LjM5NSAxMC4xODI1QzEyMy40NDYgOS43NzAwOCAxMjIuNDE3IDkuNTY5MiAxMjEuMzgxIDkuNTk0MUMxMTYuMTEzIDkuNTk0MSAxMTIuMzU4IDEzLjU4NzkgMTEyLjM1OCAxOS4yMjlDMTEyLjM1OCAyNC44NzAxIDExNS44NjEgMjguODMwMyAxMjEuMTg0IDI4LjgzMDNDMTIyLjIwOCAyOC44NjQ0IDEyMy4yMjggMjguNjcxNCAxMjQuMTY3IDI4LjI2NTRDMTI1LjEwNyAyNy44NTk1IDEyNS45NDMgMjcuMjUwOCAxMjYuNjE1IDI2LjQ4MzhWMjcuMzI0M0MxMjYuNjE1IDMwLjE2MTYgMTI0LjE3OCAzMC45Njg0IDEyMS41MjMgMzAuOTY4NEMxMTkuNjkzIDMwLjk1MDcgMTE3Ljg5MSAzMC41MTgzIDExNi4yNTUgMjkuNzA0NEwxMTQuNzY4IDMzLjQyMjZDMTE2Ljg2NSAzNC41MDc0IDExOS4xOTIgMzUuMDgzNSAxMjEuNTU3IDM1LjEwMzVDMTI2Ljk4OCAzNS4xMDM1IDEzMS40OTYgMzIuODk4MSAxMzEuNDk2IDI2LjA2NjlWMTAuMDUxM0gxMjYuOUwxMjYuODczIDExLjk4MVoiIGZpbGw9IiMxQjFBMTkiLz4KPHBhdGggZD0iTTE0NS44MiA5LjU5Mzk2QzE0NC44NTEgOS41ODAwMSAxNDMuODk0IDkuODExIDE0My4wNCAxMC4yNjUxQzE0Mi4xODYgMTAuNzE5MiAxNDEuNDYzIDExLjM4MTUgMTQwLjkzOSAxMi4xODkzVjMuMDQ1MTdIMTM2LjA1OFYyOC4zNzNIMTQwLjkzOVYxNy4zNTk3QzE0MC45MDkgMTYuOTA3MSAxNDAuOTc1IDE2LjQ1MzQgMTQxLjEzNCAxNi4wMjhDMTQxLjI5MyAxNS42MDI3IDE0MS41NDEgMTUuMjE1MyAxNDEuODYxIDE0Ljg5MTFDMTQyLjE4MSAxNC41NjY5IDE0Mi41NjcgMTQuMzEzMiAxNDIuOTkzIDE0LjE0NjZDMTQzLjQxOSAxMy45Nzk5IDE0My44NzYgMTMuOTA0MSAxNDQuMzMzIDEzLjkyNEMxNDQuNzU4IDEzLjkyNjUgMTQ1LjE3NyAxNC4wMTU1IDE0NS41NjYgMTQuMTg1MkMxNDUuOTU1IDE0LjM1NDkgMTQ2LjMwNCAxNC42MDE5IDE0Ni41OTIgMTQuOTEwN0MxNDYuODggMTUuMjE5NiAxNDcuMTAyIDE1LjU4MzggMTQ3LjI0MiAxNS45ODA3QzE0Ny4zODIgMTYuMzc3NyAxNDcuNDM5IDE2Ljc5OSAxNDcuNDA4IDE3LjIxODVWMjguMzczSDE1Mi4yNTZWMTcuNzk2OEMxNTIuMjU2IDEzLjkwMzggMTUxLjE2MyA5LjU5Mzk2IDE0NS44NTQgOS41OTM5NiIgZmlsbD0iIzFCMUExOSIvPgo8cGF0aCBkPSJNMTYyLjA3MiAyMS4wNTA5VjEzLjk5NzlIMTY1LjU0MVYxMC4wNTExSDE2Mi4wNzJWNi4xOTg0OUgxNTcuMjU5VjEwLjA1MTFIMTU1LjI4NFYxMy45OTc5SDE1Ny4yMjVWMjEuMTkyMUMxNTcuMjI1IDI2LjE2NzYgMTU5LjE3NCAyOC41ODgxIDE2My42IDI4LjU4ODFDMTY0LjI5OSAyOC42MDIxIDE2NC45OTcgMjguNTQzNSAxNjUuNjg0IDI4LjQxMzNWMjQuMzExOUMxNjUuMzg4IDI0LjMyNzQgMTY1LjA5MSAyNC4zMjc0IDE2NC43OTUgMjQuMzExOUMxNjIuOTIxIDI0LjMxMTkgMTYyLjA3OSAyMy43NTM4IDE2Mi4wNzkgMjEuMDE3MyIgZmlsbD0iIzFCMUExOSIvPgo8cGF0aCBkPSJNMTc0LjI0NSAxMi43MTM3VjEwLjAyNDNIMTY5LjQ5M1YyOC4zNzk3SDE3NC4zMzNWMjAuMzg1M0MxNzQuMzMzIDE2Ljc0MTIgMTc1LjY5MSAxNC41MDIyIDE3OS4zMjMgMTQuNTAyMlY5LjU5Mzk2QzE3OC4yNTggOS41NTYzNyAxNzcuMjA1IDkuODMyNzggMTc2LjI5OSAxMC4zODgyQzE3NS4zOTIgMTAuOTQzNiAxNzQuNjczIDExLjc1MjkgMTc0LjIzMSAxMi43MTM3IiBmaWxsPSIjMUIxQTE5Ii8+CjxwYXRoIGQ9Ik0xOTQuMTk3IDIxLjA1MTFDMTk0LjE5NyAyMy4wMTQ0IDE5Mi45MjcgMjQuNDg2OSAxOTAuOTA0IDI0LjQ4NjlDMTkwLjQ3OSAyNC40ODUzIDE5MC4wNTkgMjQuMzk3IDE4OS42NyAyNC4yMjc2QzE4OS4yODEgMjQuMDU4MiAxODguOTMxIDIzLjgxMTMgMTg4LjY0MyAyMy41MDIyQzE4OC4zNTQgMjMuMTkzMSAxODguMTMzIDIyLjgyODUgMTg3Ljk5MyAyMi40MzExQzE4Ny44NTMgMjIuMDMzNyAxODcuNzk3IDIxLjYxMiAxODcuODI5IDIxLjE5MjNWMTAuMDUxM0gxODIuOTQ4VjIwLjYzNDJDMTgyLjk0OCAyNC41MjA1IDE4NC4wODEgMjguODMwMyAxODkuMzUgMjguODMwM0MxOTAuMzI4IDI4Ljg0NTEgMTkxLjI5NCAyOC42MTU3IDE5Mi4xNTkgMjguMTYzM0MxOTMuMDIzIDI3LjcxMDkgMTkzLjc1OSAyNy4wNSAxOTQuMjk5IDI2LjI0MTdWMjguMzc5OEgxOTkuMDUxVjEwLjA1MTNIMTk0LjE3TDE5NC4xOTcgMjEuMDUxMVoiIGZpbGw9IiMxQjFBMTkiLz4KPHBhdGggZD0iTTIxMy4xOTIgOS41OTM5N0MyMTIuMjE5IDkuNTg1NTggMjExLjI1OSA5LjgxODcgMjEwLjQwMSAxMC4yNzJDMjA5LjU0MiAxMC43MjU0IDIwOC44MTIgMTEuMzg0NSAyMDguMjc3IDEyLjE4OTNWMTAuMDUxMkgyMDMuNTI0VjI4LjM3M0gyMDguNDA2VjE3LjM1OTdDMjA4LjQwNiAxNS4zOTY0IDIwOS42ODIgMTMuOTI0IDIxMS42OTggMTMuOTI0QzIxMi4xMjMgMTMuOTI2NiAyMTIuNTQyIDE0LjAxNTUgMjEyLjkzMSAxNC4xODUyQzIxMy4zMiAxNC4zNTQ5IDIxMy42NjkgMTQuNjAxOSAyMTMuOTU3IDE0LjkxMDdDMjE0LjI0NSAxNS4yMTk2IDIxNC40NjcgMTUuNTgzOCAyMTQuNjA3IDE1Ljk4MDhDMjE0Ljc0NyAxNi4zNzc3IDIxNC44MDQgMTYuNzk5IDIxNC43NzMgMTcuMjE4NVYyOC4zNzNIMjE5LjY1NFYxNy43OTY4QzIxOS42NTQgMTMuOTAzOCAyMTguNTI4IDkuNTkzOTcgMjEzLjI1MyA5LjU5Mzk3IiBmaWxsPSIjMUIxQTE5Ii8+CjxwYXRoIGQ9Ik05Mi4yNDMyIDMuODUyMDVIODcuMjUzNFYyOC4zNzk4SDEwMC4zMDhWMjMuOTI4N0g5Mi4yNDMyVjMuODUyMDVaIiBmaWxsPSIjMUIxQTE5Ii8+CjxwYXRoIGQ9Ik03Mi42NDQzIDAuNDkwMjM0TDYxLjEzNzQgNC44ODA3NUw0MC44NjYyIDQuNzI2MTFMMTQuNjgxOSAxMS45MjcxTDAuMTEzMjgxIDEwLjY4MzJMMTQuODEwOSAxNS43MTI1TDI1LjU4NDcgMTMuNzYyNkwzNC45ODcxIDE1LjQ5MDZMMzAuODY2MyAyMC4zMDQ3TDQ1LjQ0ODYgMjcuNjMzNEw0MC43NDQgMjEuMTg1NUw1NC43OTY3IDEwLjIyNkw0Ni45NDg5IDIyLjM2MjFMNTIuNDQxIDIyLjU5NzVMNDMuMDg2MSAzNy40OTAyTDY0LjgwMzMgMTcuNzgzM0w2MC45MTM0IDE3LjcwMjdMNjkuMTYxNyAxMS45OTQzTDc3LjI1MzkgMTIuMDQ4MUw3OC43NzQ2IDguNDU3NzFMNzYuMDMxOSA2LjA1NzM4TDc1LjMzMjcgNC4yODkwN0w3Mi42NDQzIDMuMDU4NjVWMC40OTAyMzRaIiBmaWxsPSIjMUIxQTE5Ii8+Cjwvc3ZnPgo=" alt="Lightrun" class="TemplateHeader-module--logoImg--5e9c4"/></a><nav class="TemplateHeader-module--navWrapper--b3c39"><div class="TemplateHeader-module--navList--a14d9"><div class="TemplateHeader-module--btnMenu--375a2"><button class="TemplateHeader-module--item--c5b2d">Dev Observability <img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iNyIgdmlld0JveD0iMCAwIDEyIDciIGZpbGw9Im5vbmUiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyI+CjxwYXRoIGQ9Ik01Ljk4MzQgNi4zMDQ2MUM1LjkwNTUxIDYuMzA1ODUgNS44MjgyIDYuMjkyMDIgNS43NTY0NyA2LjI2NDAzQzUuNjg0NzUgNi4yMzYwMyA1LjYyMDIgNi4xOTQ0OSA1LjU2NyA2LjE0MjA4TDAuNjMzNjI0IDEuMjMxODlDMC41MzcwMTUgMS4xMzUxNCAwLjQ4MzM5OCAxLjAwODUgMC40ODMzOTggMC44NzcwNzJDMC40ODMzOTggMC43NDU2NCAwLjUzNzAxNSAwLjYxOTAwNCAwLjYzMzYyNCAwLjUyMjI1NkwwLjY4NDU4NiAwLjQ3MTg5NUMwLjczNzY2MSAwLjQxODEwOCAwLjgwMjU5NiAwLjM3NTM3NiAwLjg3NTA0OSAwLjM0NjU1OEMwLjk0NzUwMSAwLjMxNzczOSAxLjAyNTggMC4zMDM0OTggMS4xMDQ3MSAwLjMwNDc4OEMxLjE4MiAwLjMwNDUwNiAxLjI1ODQ5IDAuMzE5MjQ1IDEuMzI5MTcgMC4zNDgwNEMxLjM5OTg1IDAuMzc2ODM1IDEuNDYzMTQgMC40MTkwMzkgMS41MTQ4OSAwLjQ3MTg5NUw1Ljk4OTYxIDQuOTAzNjZMMTAuNDUwNyAwLjQ3MTg5NUMxMC41MDM3IDAuNDE5MTU5IDEwLjU2OCAwLjM3NzA4NSAxMC42Mzk2IDAuMzQ4MzEyQzEwLjcxMTEgMC4zMTk1NCAxMC43ODg0IDAuMzA0Njg4IDEwLjg2NjQgMC4zMDQ2ODhDMTAuOTQ0NSAwLjMwNDY4NyAxMS4wMjE3IDAuMzE5NTQgMTEuMDkzMyAwLjM0ODMxMkMxMS4xNjQ4IDAuMzc3MDg1IDExLjIyOTIgMC40MTkxNTkgMTEuMjgyMiAwLjQ3MTg5NUwxMS4zMzMyIDAuNTIyMjU2QzExLjQyOTggMC42MTkwMDQgMTEuNDgzNCAwLjc0NTY0IDExLjQ4MzQgMC44NzcwNzJDMTEuNDgzNCAxLjAwODUgMTEuNDI5OCAxLjEzNTE0IDExLjMzMzIgMS4yMzE4OUw2LjM5ODU1IDYuMTQyMDhDNi4zNDU1OSA2LjE5NDQ2IDYuMjgxMjYgNi4yMzU5OSA2LjIwOTc0IDYuMjYzOTlDNi4xMzgyMiA2LjI5MTk5IDYuMDYxMSA2LjMwNTgzIDUuOTgzNCA2LjMwNDYxWiIgZmlsbD0iIzFCMUExOSIvPgo8L3N2Zz4K" alt="arrow_down"/></button><div class="SharedMenu-module--wrapperContainer--6e38e "><div class="SharedMenu-module--wrapper--49c2c"><p class="titleGradient">Dev Observability</p><div class="SharedMenu-module--menuList--d425c"><a href="https://lightrun.com/developer-observability/" class="SharedMenu-module--link--ad046">What is Developer Observability?</a><a href="https://lightrun.com/why-lightrun/" class="SharedMenu-module--link--ad046">Why Lightrun?</a><a href="https://lightrun.com/architecture/" class="SharedMenu-module--link--ad046">Lightrun Architecture</a><a href="https://lightrun.com/sdk/" class="SharedMenu-module--link--ad046"><span>The Lightrun SDK</span><sup>TM</sup></a><a href="https://lightrun.com/plugin/" class="SharedMenu-module--link--ad046">The Lightrun IDE Plugin</a><a href="https://lightrun.com/security/" class="SharedMenu-module--link--ad046">Security</a><a href="https://lightrun.com/comparisons/" class="SharedMenu-module--link--ad046">Comparisons</a><a href="https://lightrun.com/integrations/" class="SharedMenu-module--link--ad046">Integrations</a></div><div class="SharedMenu-module--arrow--d0e9b "/></div></div></div><div class="TemplateHeader-module--btnMenu--375a2"><button class="TemplateHeader-module--item--c5b2d">Product <img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iNyIgdmlld0JveD0iMCAwIDEyIDciIGZpbGw9Im5vbmUiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyI+CjxwYXRoIGQ9Ik01Ljk4MzQgNi4zMDQ2MUM1LjkwNTUxIDYuMzA1ODUgNS44MjgyIDYuMjkyMDIgNS43NTY0NyA2LjI2NDAzQzUuNjg0NzUgNi4yMzYwMyA1LjYyMDIgNi4xOTQ0OSA1LjU2NyA2LjE0MjA4TDAuNjMzNjI0IDEuMjMxODlDMC41MzcwMTUgMS4xMzUxNCAwLjQ4MzM5OCAxLjAwODUgMC40ODMzOTggMC44NzcwNzJDMC40ODMzOTggMC43NDU2NCAwLjUzNzAxNSAwLjYxOTAwNCAwLjYzMzYyNCAwLjUyMjI1NkwwLjY4NDU4NiAwLjQ3MTg5NUMwLjczNzY2MSAwLjQxODEwOCAwLjgwMjU5NiAwLjM3NTM3NiAwLjg3NTA0OSAwLjM0NjU1OEMwLjk0NzUwMSAwLjMxNzczOSAxLjAyNTggMC4zMDM0OTggMS4xMDQ3MSAwLjMwNDc4OEMxLjE4MiAwLjMwNDUwNiAxLjI1ODQ5IDAuMzE5MjQ1IDEuMzI5MTcgMC4zNDgwNEMxLjM5OTg1IDAuMzc2ODM1IDEuNDYzMTQgMC40MTkwMzkgMS41MTQ4OSAwLjQ3MTg5NUw1Ljk4OTYxIDQuOTAzNjZMMTAuNDUwNyAwLjQ3MTg5NUMxMC41MDM3IDAuNDE5MTU5IDEwLjU2OCAwLjM3NzA4NSAxMC42Mzk2IDAuMzQ4MzEyQzEwLjcxMTEgMC4zMTk1NCAxMC43ODg0IDAuMzA0Njg4IDEwLjg2NjQgMC4zMDQ2ODhDMTAuOTQ0NSAwLjMwNDY4NyAxMS4wMjE3IDAuMzE5NTQgMTEuMDkzMyAwLjM0ODMxMkMxMS4xNjQ4IDAuMzc3MDg1IDExLjIyOTIgMC40MTkxNTkgMTEuMjgyMiAwLjQ3MTg5NUwxMS4zMzMyIDAuNTIyMjU2QzExLjQyOTggMC42MTkwMDQgMTEuNDgzNCAwLjc0NTY0IDExLjQ4MzQgMC44NzcwNzJDMTEuNDgzNCAxLjAwODUgMTEuNDI5OCAxLjEzNTE0IDExLjMzMzIgMS4yMzE4OUw2LjM5ODU1IDYuMTQyMDhDNi4zNDU1OSA2LjE5NDQ2IDYuMjgxMjYgNi4yMzU5OSA2LjIwOTc0IDYuMjYzOTlDNi4xMzgyMiA2LjI5MTk5IDYuMDYxMSA2LjMwNTgzIDUuOTgzNCA2LjMwNDYxWiIgZmlsbD0iIzFCMUExOSIvPgo8L3N2Zz4K" alt="arrow_down"/></button><div class="SharedMenu-module--wrapperContainer--6e38e SharedMenu-module--expandedMenuContainer--4c975"><div class="SharedMenu-module--wrapper--49c2c"><div class="SharedMenu-module--productWrapper--40db0"><div><div class="titleGradient">Architectures</div><div class="SharedMenu-module--mainBlockMenu--064a3"><div class="SharedMenu-module--menuBlock--9a914"><div class="SharedMenu-module--subTitleList--11ca1">Deployment Patterns</div><div class="SharedMenu-module--menuList--d425c"><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/kubernetes-troubleshooting/">Kubernetes Debugging</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/serverless-debugging/">Serverless Debugging</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/feature-flag-validation/">Feature Flag Debugging</a></div></div><div class="SharedMenu-module--menuBlock--9a914"><div class="SharedMenu-module--subTitleList--11ca1">Environments</div><div class="SharedMenu-module--menuList--d425c"><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/enviroments/dev-qa-staging/">Dev/QA/Staging</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/enviroments/ci-cd-pipelines/">CI/CD</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/enviroments/production/">Production</a></div></div></div></div><div><div class="titleGradient">Roles</div><div class="SharedMenu-module--mainBlockMenu--064a3"><div><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/roles/backend-developer/">Backend Developer</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/roles/devops-sre/">DevOps Engineer/SRE</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/roles/engineering-leader/">Engineering Leader</a></div></div></div><div><div class="titleGradient">Benefits</div><div class="SharedMenu-module--mainBlockMenu--064a3"><div><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/use-cases/reduce-mttr/">Reduce MTTR</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/use-cases/improve-developer-productivity/">Improve Dev Productivity</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/use-cases/optimize-logging-costs/">Optimize Logging Costs</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/use-cases/reduce-time-to-market/">Reduce Time to Market</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/use-cases/improve-dora-metrics/">Improove DORA metrics</a></div></div></div><div><div class="titleGradient">Features</div><div class="SharedMenu-module--mainBlockMenu--064a3"><div><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/logs/">Dynamic Logs</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/metrics/">Zero-config Metrics</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/snapshots/">Snapshots (Virtual Breakpoints)</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/integrations/#">Integrations</a><a class="SharedMenu-module--link--ad046" href="https://lightrun.com/integrations/#">Comparisons</a></div></div></div><div class="SharedMenu-module--watchNowBar--38120"><div class="WatchNow-module--watchNow--0a727 SharedMenu-module--watchBarPanel--43c6e"><span class="titleGradient WatchNow-module--newTitle--646e1">NEW!</span><span class="WatchNow-module--description--bb7f0">Watch our log cost reduction masterclass with Google, Shopify and the CNCF!<a href="https://lightrun.com/resources/the-hidden-cost-of-overlogging/" class="WatchNow-module--watchNowLink--22d33">Watch Now&gt;</a></span></div></div></div><div class="SharedMenu-module--arrow--d0e9b SharedMenu-module--expandedMenuArrow--4fdac"/></div></div></div><a href="https://lightrun.com/pricing" class="TemplateHeader-module--item--c5b2d">Pricing</a><a href="https://docs.lightrun.com/" class="TemplateHeader-module--item--c5b2d">Docs</a><div class="TemplateHeader-module--btnMenu--375a2"><button class="TemplateHeader-module--item--c5b2d">Resources <img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iNyIgdmlld0JveD0iMCAwIDEyIDciIGZpbGw9Im5vbmUiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyI+CjxwYXRoIGQ9Ik01Ljk4MzQgNi4zMDQ2MUM1LjkwNTUxIDYuMzA1ODUgNS44MjgyIDYuMjkyMDIgNS43NTY0NyA2LjI2NDAzQzUuNjg0NzUgNi4yMzYwMyA1LjYyMDIgNi4xOTQ0OSA1LjU2NyA2LjE0MjA4TDAuNjMzNjI0IDEuMjMxODlDMC41MzcwMTUgMS4xMzUxNCAwLjQ4MzM5OCAxLjAwODUgMC40ODMzOTggMC44NzcwNzJDMC40ODMzOTggMC43NDU2NCAwLjUzNzAxNSAwLjYxOTAwNCAwLjYzMzYyNCAwLjUyMjI1NkwwLjY4NDU4NiAwLjQ3MTg5NUMwLjczNzY2MSAwLjQxODEwOCAwLjgwMjU5NiAwLjM3NTM3NiAwLjg3NTA0OSAwLjM0NjU1OEMwLjk0NzUwMSAwLjMxNzczOSAxLjAyNTggMC4zMDM0OTggMS4xMDQ3MSAwLjMwNDc4OEMxLjE4MiAwLjMwNDUwNiAxLjI1ODQ5IDAuMzE5MjQ1IDEuMzI5MTcgMC4zNDgwNEMxLjM5OTg1IDAuMzc2ODM1IDEuNDYzMTQgMC40MTkwMzkgMS41MTQ4OSAwLjQ3MTg5NUw1Ljk4OTYxIDQuOTAzNjZMMTAuNDUwNyAwLjQ3MTg5NUMxMC41MDM3IDAuNDE5MTU5IDEwLjU2OCAwLjM3NzA4NSAxMC42Mzk2IDAuMzQ4MzEyQzEwLjcxMTEgMC4zMTk1NCAxMC43ODg0IDAuMzA0Njg4IDEwLjg2NjQgMC4zMDQ2ODhDMTAuOTQ0NSAwLjMwNDY4NyAxMS4wMjE3IDAuMzE5NTQgMTEuMDkzMyAwLjM0ODMxMkMxMS4xNjQ4IDAuMzc3MDg1IDExLjIyOTIgMC40MTkxNTkgMTEuMjgyMiAwLjQ3MTg5NUwxMS4zMzMyIDAuNTIyMjU2QzExLjQyOTggMC42MTkwMDQgMTEuNDgzNCAwLjc0NTY0IDExLjQ4MzQgMC44NzcwNzJDMTEuNDgzNCAxLjAwODUgMTEuNDI5OCAxLjEzNTE0IDExLjMzMzIgMS4yMzE4OUw2LjM5ODU1IDYuMTQyMDhDNi4zNDU1OSA2LjE5NDQ2IDYuMjgxMjYgNi4yMzU5OSA2LjIwOTc0IDYuMjYzOTlDNi4xMzgyMiA2LjI5MTk5IDYuMDYxMSA2LjMwNTgzIDUuOTgzNCA2LjMwNDYxWiIgZmlsbD0iIzFCMUExOSIvPgo8L3N2Zz4K" alt="arrow_down"/></button><div class="SharedMenu-module--wrapperContainer--6e38e "><div class="SharedMenu-module--wrapper--49c2c"><p class="titleGradient">Resources</p><div class="SharedMenu-module--menuList--d425c"><a href="https://lightrun.com/categories_resources/case-studies/" class="SharedMenu-module--link--ad046">Case studies</a><a href="https://lightrun.com/categories_resources/data-sheets/" class="SharedMenu-module--link--ad046">Data Sheets</a><a href="https://lightrun.com/categories_resources/press/" class="SharedMenu-module--link--ad046">Press</a><a href="https://lightrun.com/categories_resources/webinars/" class="SharedMenu-module--link--ad046">Webinars</a></div><div class="SharedMenu-module--arrow--d0e9b "/></div></div></div><a href="https://lightrun.com/blog/" class="TemplateHeader-module--item--c5b2d">Blog</a><div class="TemplateHeader-module--btnMenu--375a2"><button class="TemplateHeader-module--item--c5b2d">Company <img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iNyIgdmlld0JveD0iMCAwIDEyIDciIGZpbGw9Im5vbmUiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyI+CjxwYXRoIGQ9Ik01Ljk4MzQgNi4zMDQ2MUM1LjkwNTUxIDYuMzA1ODUgNS44MjgyIDYuMjkyMDIgNS43NTY0NyA2LjI2NDAzQzUuNjg0NzUgNi4yMzYwMyA1LjYyMDIgNi4xOTQ0OSA1LjU2NyA2LjE0MjA4TDAuNjMzNjI0IDEuMjMxODlDMC41MzcwMTUgMS4xMzUxNCAwLjQ4MzM5OCAxLjAwODUgMC40ODMzOTggMC44NzcwNzJDMC40ODMzOTggMC43NDU2NCAwLjUzNzAxNSAwLjYxOTAwNCAwLjYzMzYyNCAwLjUyMjI1NkwwLjY4NDU4NiAwLjQ3MTg5NUMwLjczNzY2MSAwLjQxODEwOCAwLjgwMjU5NiAwLjM3NTM3NiAwLjg3NTA0OSAwLjM0NjU1OEMwLjk0NzUwMSAwLjMxNzczOSAxLjAyNTggMC4zMDM0OTggMS4xMDQ3MSAwLjMwNDc4OEMxLjE4MiAwLjMwNDUwNiAxLjI1ODQ5IDAuMzE5MjQ1IDEuMzI5MTcgMC4zNDgwNEMxLjM5OTg1IDAuMzc2ODM1IDEuNDYzMTQgMC40MTkwMzkgMS41MTQ4OSAwLjQ3MTg5NUw1Ljk4OTYxIDQuOTAzNjZMMTAuNDUwNyAwLjQ3MTg5NUMxMC41MDM3IDAuNDE5MTU5IDEwLjU2OCAwLjM3NzA4NSAxMC42Mzk2IDAuMzQ4MzEyQzEwLjcxMTEgMC4zMTk1NCAxMC43ODg0IDAuMzA0Njg4IDEwLjg2NjQgMC4zMDQ2ODhDMTAuOTQ0NSAwLjMwNDY4NyAxMS4wMjE3IDAuMzE5NTQgMTEuMDkzMyAwLjM0ODMxMkMxMS4xNjQ4IDAuMzc3MDg1IDExLjIyOTIgMC40MTkxNTkgMTEuMjgyMiAwLjQ3MTg5NUwxMS4zMzMyIDAuNTIyMjU2QzExLjQyOTggMC42MTkwMDQgMTEuNDgzNCAwLjc0NTY0IDExLjQ4MzQgMC44NzcwNzJDMTEuNDgzNCAxLjAwODUgMTEuNDI5OCAxLjEzNTE0IDExLjMzMzIgMS4yMzE4OUw2LjM5ODU1IDYuMTQyMDhDNi4zNDU1OSA2LjE5NDQ2IDYuMjgxMjYgNi4yMzU5OSA2LjIwOTc0IDYuMjYzOTlDNi4xMzgyMiA2LjI5MTk5IDYuMDYxMSA2LjMwNTgzIDUuOTgzNCA2LjMwNDYxWiIgZmlsbD0iIzFCMUExOSIvPgo8L3N2Zz4K" alt="arrow_down"/></button><div class="SharedMenu-module--wrapperContainer--6e38e "><div class="SharedMenu-module--wrapper--49c2c"><p class="titleGradient">Company</p><div class="SharedMenu-module--menuList--d425c"><a href="https://www.linkedin.com/company/lightruntech/jobs/" class="SharedMenu-module--link--ad046">Careers</a><a href="https://go.lightrun.com/contact-us" class="SharedMenu-module--link--ad046">Contact Us</a></div><div class="SharedMenu-module--arrow--d0e9b "/></div></div></div><a href="https://playground.lightrun.com" class="TemplateHeader-module--item--c5b2d TemplateHeader-module--itemWordle--b9122"><span class="TemplateHeader-module--linkWord--2d9ef">Debug 🆆🅾🆁🅳🅻🅴</span></a></div><ul class="ControlButtons-module--linkList--df15b"><li class="ControlButtons-module--underLine--a2f91"><a href="https://app.lightrun.com/api/oauth/login">Log in</a></li><li class="ControlButtons-module--item--da1af"><a href="https://lightrun.com/get-a-lightrun-demo/" class="ButtonLink-module--linkBtn--3a273 ButtonLink-module--transparent--5a2f9 ">Book a Demo</a></li><li class="ControlButtons-module--item--da1af"><a href="https://app.lightrun.com/api/oauth/register" class="ButtonLink-module--linkBtn--3a273 ButtonLink-module--fill--6b8b9 ">Start For Free</a></li></ul></nav><button class="Burger-module--burger--9ead4 " title="Navigation"><span class="Burger-module--line--8f8d0"/><span class="Burger-module--line--8f8d0"/><span class="Burger-module--line--8f8d0"/></button></div><div class="TemplateHeader-module--menu--44853 "><div class="MobileMenu-module--mobileMenu--040cc"><div class="Container-module--container--052f0"><ul class="MobileMenu-module--containerNav--c271d"><li class="MobileMenu-module--navItem--99a59"><div class="MobileMenu-module--titleMenuItem--d0f06"><span>Dev Observability</span><img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iMjAiIHZpZXdCb3g9IjAgMCAxMiAyMCIgZmlsbD0ibm9uZSIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KPHBhdGggZD0iTTcuOTczNzNlLTA3IDE4LjIxMjFMMS44MjAwNSAyMEwxMiAxMEwxLjgyMDA1IDguODk5NTllLTA3TC02LjM4NDhlLTA3IDEuNzg3ODhMOC4zNTk5IDEwTDcuOTczNzNlLTA3IDE4LjIxMjFaIiBmaWxsPSJ1cmwoI3BhaW50MF9saW5lYXJfNTE2XzEyNjApIi8+CjxkZWZzPgo8bGluZWFyR3JhZGllbnQgaWQ9InBhaW50MF9saW5lYXJfNTE2XzEyNjAiIHgxPSIxMiIgeTE9IjEwIiB4Mj0iLTIuMDcxMyIgeTI9IjguMjYzMDMiIGdyYWRpZW50VW5pdHM9InVzZXJTcGFjZU9uVXNlIj4KPHN0b3Agc3RvcC1jb2xvcj0iIzI4QTFDMCIvPgo8c3RvcCBvZmZzZXQ9IjEiIHN0b3AtY29sb3I9IiMxNjQ4OUMiLz4KPC9saW5lYXJHcmFkaWVudD4KPC9kZWZzPgo8L3N2Zz4K" alt="arrow" class="MobileMenu-module--arrow--1311d "/></div></li><li class="MobileMenu-module--navItem--99a59"><div class="MobileMenu-module--titleMenuItem--d0f06"><span>Product</span><img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iMjAiIHZpZXdCb3g9IjAgMCAxMiAyMCIgZmlsbD0ibm9uZSIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KPHBhdGggZD0iTTcuOTczNzNlLTA3IDE4LjIxMjFMMS44MjAwNSAyMEwxMiAxMEwxLjgyMDA1IDguODk5NTllLTA3TC02LjM4NDhlLTA3IDEuNzg3ODhMOC4zNTk5IDEwTDcuOTczNzNlLTA3IDE4LjIxMjFaIiBmaWxsPSJ1cmwoI3BhaW50MF9saW5lYXJfNTE2XzEyNjApIi8+CjxkZWZzPgo8bGluZWFyR3JhZGllbnQgaWQ9InBhaW50MF9saW5lYXJfNTE2XzEyNjAiIHgxPSIxMiIgeTE9IjEwIiB4Mj0iLTIuMDcxMyIgeTI9IjguMjYzMDMiIGdyYWRpZW50VW5pdHM9InVzZXJTcGFjZU9uVXNlIj4KPHN0b3Agc3RvcC1jb2xvcj0iIzI4QTFDMCIvPgo8c3RvcCBvZmZzZXQ9IjEiIHN0b3AtY29sb3I9IiMxNjQ4OUMiLz4KPC9saW5lYXJHcmFkaWVudD4KPC9kZWZzPgo8L3N2Zz4K" alt="arrow" class="MobileMenu-module--arrow--1311d "/></div></li><li class="MobileMenu-module--navItem--99a59"><a href="https://lightrun.com/pricing" class="MobileMenu-module--linkMenuItem--341df">Pricing</a></li><li class="MobileMenu-module--navItem--99a59"><a href="https://docs.lightrun.com/" class="MobileMenu-module--linkMenuItem--341df">Docs</a></li><li class="MobileMenu-module--navItem--99a59"><div class="MobileMenu-module--titleMenuItem--d0f06"><span>Resources</span><img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iMjAiIHZpZXdCb3g9IjAgMCAxMiAyMCIgZmlsbD0ibm9uZSIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KPHBhdGggZD0iTTcuOTczNzNlLTA3IDE4LjIxMjFMMS44MjAwNSAyMEwxMiAxMEwxLjgyMDA1IDguODk5NTllLTA3TC02LjM4NDhlLTA3IDEuNzg3ODhMOC4zNTk5IDEwTDcuOTczNzNlLTA3IDE4LjIxMjFaIiBmaWxsPSJ1cmwoI3BhaW50MF9saW5lYXJfNTE2XzEyNjApIi8+CjxkZWZzPgo8bGluZWFyR3JhZGllbnQgaWQ9InBhaW50MF9saW5lYXJfNTE2XzEyNjAiIHgxPSIxMiIgeTE9IjEwIiB4Mj0iLTIuMDcxMyIgeTI9IjguMjYzMDMiIGdyYWRpZW50VW5pdHM9InVzZXJTcGFjZU9uVXNlIj4KPHN0b3Agc3RvcC1jb2xvcj0iIzI4QTFDMCIvPgo8c3RvcCBvZmZzZXQ9IjEiIHN0b3AtY29sb3I9IiMxNjQ4OUMiLz4KPC9saW5lYXJHcmFkaWVudD4KPC9kZWZzPgo8L3N2Zz4K" alt="arrow" class="MobileMenu-module--arrow--1311d "/></div></li><li class="MobileMenu-module--navItem--99a59"><a href="https://lightrun.com/blog/" class="MobileMenu-module--linkMenuItem--341df">Blog</a></li><li class="MobileMenu-module--navItem--99a59"><div class="MobileMenu-module--titleMenuItem--d0f06"><span>Company</span><img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMTIiIGhlaWdodD0iMjAiIHZpZXdCb3g9IjAgMCAxMiAyMCIgZmlsbD0ibm9uZSIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KPHBhdGggZD0iTTcuOTczNzNlLTA3IDE4LjIxMjFMMS44MjAwNSAyMEwxMiAxMEwxLjgyMDA1IDguODk5NTllLTA3TC02LjM4NDhlLTA3IDEuNzg3ODhMOC4zNTk5IDEwTDcuOTczNzNlLTA3IDE4LjIxMjFaIiBmaWxsPSJ1cmwoI3BhaW50MF9saW5lYXJfNTE2XzEyNjApIi8+CjxkZWZzPgo8bGluZWFyR3JhZGllbnQgaWQ9InBhaW50MF9saW5lYXJfNTE2XzEyNjAiIHgxPSIxMiIgeTE9IjEwIiB4Mj0iLTIuMDcxMyIgeTI9IjguMjYzMDMiIGdyYWRpZW50VW5pdHM9InVzZXJTcGFjZU9uVXNlIj4KPHN0b3Agc3RvcC1jb2xvcj0iIzI4QTFDMCIvPgo8c3RvcCBvZmZzZXQ9IjEiIHN0b3AtY29sb3I9IiMxNjQ4OUMiLz4KPC9saW5lYXJHcmFkaWVudD4KPC9kZWZzPgo8L3N2Zz4K" alt="arrow" class="MobileMenu-module--arrow--1311d "/></div></li><li class="MobileMenu-module--navItem--99a59"><a href="https://playground.lightrun.com" class="MobileMenu-module--linkMenuItem--341df">Debug Wordle</a></li></ul><div class="MobileMenu-module--controlButtons--b6016"><ul class="ControlButtons-module--linkList--df15b"><li class="ControlButtons-module--underLine--a2f91"><a href="https://app.lightrun.com/api/oauth/login">Log in</a></li><li class="ControlButtons-module--item--da1af"><a href="https://lightrun.com/get-a-lightrun-demo/" class="ButtonLink-module--linkBtn--3a273 ButtonLink-module--transparent--5a2f9 ">Book a Demo</a></li><li class="ControlButtons-module--item--da1af"><a href="https://app.lightrun.com/api/oauth/register" class="ButtonLink-module--linkBtn--3a273 ButtonLink-module--fill--6b8b9 ">Start For Free</a></li></ul></div></div></div></div></div></header><main><div class="Hero-module--hero--e76bd"><div class="Container-module--container--052f0"><div class="Hero-module--overlay--92431"><img src="/answers/static/question-mark-6a6962885f54fa6c88cf5e38232283da.png" alt="question-mark" class="Hero-module--heroImg--8554a"/><div class="Hero-module--wrapper--29990"><h1>Stuck on an issue?</h1><p class="Hero-module--description--894ed">Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.<br/></p><p class="Hero-module--description--894ed Hero-module--strongText--4ea65">And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.</p><button class="Hero-module--btnHero--4efca">Talk to a Lightrun Answers expert</button></div></div></div></div><section class="sectionWrapper IssueSummary-module--issueSummary--29ccb"><div class="Container-module--container--052f0"><div class="IssueSummary-module--wrapper--5e867"><h2 class="IssueSummary-module--title--1229e">GCS decompressive transcoding not supported when reading </h2><a href="https://github.com/RaRe-Technologies/smart_open/issues/422" class="IssueSummary-module--linkUnderline--4cc7f">See original GitHub issue</a></div><div class="IssueSummary-module--wrapperGrid--5ff55"><div class="IssueSummary-module--descriptionWrapper--3a1cb"><h3>Issue Description</h3><div class="LeftScrollContainer-module--wrapper--9987b IssueSummary-module--textContainer--3e705 "><div class="LeftScrollContainer-module--content--0b83d"><div><h4>Problem description</h4> <p>Using <code>smart_open</code> (<strong>unreleased version with GCS support</strong>) to download files from GCS with transparent <a href="https://cloud.google.com/storage/docs/transcoding">decompressive transcoding</a> enabled <em>may</em> lead to incomplete files being downloaded depending on the compressed file size.</p> <p>With Google Cloud Storage there is the option to store gzip-compressed files &amp; use decompressive transcoding to transparently decompress these when downloading. Decompression is thenhandled by Google servers. In this case, the filename wouldn’t have any compression extension (eg. <code>file.csv</code>), however when inspecting it’s metadata, it would contain something like that:</p> "Content-Type": "text/csv; charset=utf-8", "Content-Encoding": "gzip" <p>This would be fine if it weren’t for the fact that in such cases, <code>Blob()._size</code> will return the <em>compressed size</em>. Since <code>smart_open</code> uses this to understand when to stop reading, it results in incomplete files.</p> <h4>Steps/code to reproduce the problem</h4> <p>write ~400KB file (larger than <a href="https://github.com/RaRe-Technologies/smart_open/blob/72818ca6d3a0a99e1717ab31db72bf109ac5ce65/smart_open/gcs.py#L49">smart_opens’s default buffer size</a>)</p> <pre><code class="language-bash">$ cat /dev/urandom | gtr -dc A-Za-z0-9 | head -c 400000 &gt; rand.txt $ ls -l total 1024 -rw-r--r-- 1 gustavomachado staff 524288 Feb 17 12:34 rand.txt <p>upload file to GCS</p> <pre><code class="language-bash">$ gsutil cp -Z ./rand.txt gs://my-bucket/ Copying file://./rand.txt [Content-Type=text/plain]... - [1 files][293.8 KiB/293.8 KiB] Operation completed over 1 objects/293.8 KiB. <p>resulting (compressed) file is 293.8 KiB.</p> <p>check file metadata</p> <pre><code class="language-bash">$ gsutil stat gs://my-bucket/rand.txt gs://my-bucket/rand.txt: Creation time: Mon, 17 Feb 2020 13:45:36 GMT Update time: Mon, 17 Feb 2020 13:45:36 GMT Storage class: MULTI_REGIONAL Cache-Control: no-transform Content-Encoding: gzip Content-Language: en Content-Length: 300842 Content-Type: text/plain Hash (crc32c): Ko+ooA== Hash (md5): 8C6OlwZIR+fgRMy2xmQqLw== ETag: CNWW+Kjc2OcCEAE= Generation: 1581947136379733 Metageneration: 1 <p>download file using <code>smart_open</code> (gcloud credentials already set)</p> <pre><code class="language-python">&gt;&gt;&gt; from smart_open import open &gt;&gt;&gt; with open('gs://my-bucket/rand.txt', 'r') as fin: ... with open('downloaded.txt', 'w') as fout: ... for line in fin: ... fout.write(line) 348550 <p>check resulting file size</p> <pre><code class="language-bash">$ ls -l total 1472 -rw-r--r-- 1 gustavomachado staff 348550 Feb 17 14:48 downloaded.txt -rw-r--r-- 1 gustavomachado staff 400000 Feb 17 14:45 rand.txt <p>original file is 400KB however downloaded file is 348KB. not sure why it’s still bigger than the <code>300842</code> reported by Google, though.</p> <h4>Versions</h4> <p>Please provide the output of:</p> <pre><code class="language-python">&gt;&gt;&gt; import platform, sys, smart_open &gt;&gt;&gt; print(platform.platform()) Darwin-18.7.0-x86_64-i386-64bit &gt;&gt;&gt; print("Python", sys.version) Python 3.7.2 (default, Dec 9 2019, 14:10:57) [Clang 10.0.1 (clang-1001.0.46.4)] &gt;&gt;&gt; print("smart_open", smart_open.__version__) smart_open 1.9.0 <p><code>smart_open</code> has been pinned to <a href="https://github.com/RaRe-Technologies/smart_open/commit/72818ca6d3a0a99e1717ab31db72bf109ac5ce65">72818ca</a>, installed with</p> <pre><code class="language-bash">$ pip install git+git://github.com/RaRe-Technologies/smart_open.git@72818ca6d3a0a99e1717ab31db72bf109ac5ce65 <h4>Checklist</h4> <p>Before you create the issue, please make sure you have:</p> <li class="task-list-item"><input class="task-list-item-checkbox" checked="" disabled="" type="checkbox"/> Described the problem clearly</li> <li class="task-list-item"><input class="task-list-item-checkbox" checked="" disabled="" type="checkbox"/> Provided a minimal reproducible example, including any required data</li> <li class="task-list-item"><input class="task-list-item-checkbox" checked="" disabled="" type="checkbox"/> Provided the version numbers of the relevant software</li> <h4>Possible solutions</h4> <p>Setting <code>buffer_size</code> to a value larger than the compressed file size will of course download it in it’s entirety, but for large files that would mean loading the entire file into memory.</p> <p>A reasonable option would be to check <code>Blob().content_type</code>, and if it is equal to <code>'gzip'</code>, call <code>Blob().download_as_string</code> with <code>raw_download=True</code>, and then somehow handle decompression internally with the already-existing decompression mechanisms</p> <p>If the maintainers agree this would be a viable solution, I’ll be happy to provide a PR implementing it.</p> </div></div></div></div><div class="IssueSummary-module--descriptionWrapper--3a1cb"><h3>Issue Analytics</h3><ul class="IssueSummary-module--analyticsWrapper--8f2e1"><li><span class="IssueSummary-module--boldTitle--7ed35">State:</span><img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iODEiIGhlaWdodD0iMzEiIHZpZXdCb3g9IjAgMCA4MSAzMSIgZmlsbD0ibm9uZSIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KPHJlY3QgeD0iMC41IiB5PSIwLjQ1MTE3MiIgd2lkdGg9Ijc3IiBoZWlnaHQ9IjMwIiByeD0iMTUiIGZpbGw9IiM2OUFFNkQiLz4KPHBhdGggZD0iTTM5LjMyMzkgMTUuMzYwM0MzOS4zMjM5IDE2LjQzNDEgMzkuMTMgMTcuMzYyMiAzOC43NDIyIDE4LjE0NDRDMzguMzU0NCAxOC45MjY2IDM3LjgyMjQgMTkuNTI5OCAzNy4xNDYzIDE5Ljk1NEMzNi40NzAyIDIwLjM3ODMgMzUuNjk3OSAyMC41OTA0IDM0LjgyOTUgMjAuNTkwNEMzMy45NjEyIDIwLjU5MDQgMzMuMTg4OSAyMC4zNzgzIDMyLjUxMjggMTkuOTU0QzMxLjgzNjYgMTkuNTI5OCAzMS4zMDQ3IDE4LjkyNjYgMzAuOTE2OSAxOC4xNDQ0QzMwLjUyOTEgMTcuMzYyMiAzMC4zMzUyIDE2LjQzNDEgMzAuMzM1MiAxNS4zNjAzQzMwLjMzNTIgMTQuMjg2NCAzMC41MjkxIDEzLjM1ODQgMzAuOTE2OSAxMi41NzYyQzMxLjMwNDcgMTEuNzk0IDMxLjgzNjYgMTEuMTkwOCAzMi41MTI4IDEwLjc2NjVDMzMuMTg4OSAxMC4zNDIzIDMzLjk2MTIgMTAuMTMwMSAzNC44Mjk1IDEwLjEzMDFDMzUuNjk3OSAxMC4xMzAxIDM2LjQ3MDIgMTAuMzQyMyAzNy4xNDYzIDEwLjc2NjVDMzcuODIyNCAxMS4xOTA4IDM4LjM1NDQgMTEuNzk0IDM4Ljc0MjIgMTIuNTc2MkMzOS4xMyAxMy4zNTg0IDM5LjMyMzkgMTQuMjg2NCAzOS4zMjM5IDE1LjM2MDNaTTM4LjEzMDcgMTUuMzYwM0MzOC4xMzA3IDE0LjQ3ODYgMzcuOTgzMiAxMy43MzQ2IDM3LjY4ODIgMTMuMTI4QzM3LjM5NjUgMTIuNTIxNSAzNy4wMDA1IDEyLjA2MjQgMzYuNSAxMS43NTA5QzM2LjAwMjggMTEuNDM5MyAzNS40NDYgMTEuMjgzNiAzNC44Mjk1IDExLjI4MzZDMzQuMjEzMSAxMS4yODM2IDMzLjY1NDYgMTEuNDM5MyAzMy4xNTQxIDExLjc1MDlDMzIuNjU3IDEyLjA2MjQgMzIuMjYwOSAxMi41MjE1IDMxLjk2NTkgMTMuMTI4QzMxLjY3NDIgMTMuNzM0NiAzMS41Mjg0IDE0LjQ3ODYgMzEuNTI4NCAxNS4zNjAzQzMxLjUyODQgMTYuMjQxOSAzMS42NzQyIDE2Ljk4NiAzMS45NjU5IDE3LjU5MjVDMzIuMjYwOSAxOC4xOTkgMzIuNjU3IDE4LjY1ODEgMzMuMTU0MSAxOC45Njk2QzMzLjY1NDYgMTkuMjgxMiAzNC4yMTMxIDE5LjQzNyAzNC44Mjk1IDE5LjQzN0MzNS40NDYgMTkuNDM3IDM2LjAwMjggMTkuMjgxMiAzNi41IDE4Ljk2OTZDMzcuMDAwNSAxOC42NTgxIDM3LjM5NjUgMTguMTk5IDM3LjY4ODIgMTcuNTkyNUMzNy45ODMyIDE2Ljk4NiAzOC4xMzA3IDE2LjI0MTkgMzguMTMwNyAxNS4zNjAzWk00MS4yMzc5IDIzLjMxNDhWMTIuODE0OEg0Mi4zNzE0VjE0LjAyNzlINDIuNTEwN0M0Mi41OTY4IDEzLjg5NTMgNDIuNzE2MSAxMy43MjYzIDQyLjg2ODYgMTMuNTIwOEM0My4wMjQ0IDEzLjMxMiA0My4yNDY0IDEzLjEyNjQgNDMuNTM0OCAxMi45NjRDNDMuODI2NSAxMi43OTgyIDQ0LjIyMDkgMTIuNzE1NCA0NC43MTggMTIuNzE1NEM0NS4zNjEgMTIuNzE1NCA0NS45Mjc4IDEyLjg3NjEgNDYuNDE4MyAxMy4xOTc2QzQ2LjkwODkgMTMuNTE5MSA0Ny4yOTE3IDEzLjk3NDggNDcuNTY2OCAxNC41NjQ4QzQ3Ljg0MTkgMTUuMTU0OCA0Ny45Nzk0IDE1Ljg1MDggNDcuOTc5NCAxNi42NTI5QzQ3Ljk3OTQgMTcuNDYxNiA0Ny44NDE5IDE4LjE2MjYgNDcuNTY2OCAxOC43NTU5QzQ3LjI5MTcgMTkuMzQ1OCA0Ni45MTA1IDE5LjgwMzIgNDYuNDIzMyAyMC4xMjhDNDUuOTM2MSAyMC40NDk1IDQ1LjM3NDMgMjAuNjEwMyA0NC43Mzc5IDIwLjYxMDNDNDQuMjQ3NCAyMC42MTAzIDQzLjg1NDYgMjAuNTI5MSA0My41NTk3IDIwLjM2NjdDNDMuMjY0NyAyMC4yMDA5IDQzLjAzNzYgMjAuMDEzNyA0Mi44Nzg2IDE5LjgwNDlDNDIuNzE5NSAxOS41OTI3IDQyLjU5NjggMTkuNDE3MSA0Mi41MTA3IDE5LjI3NzlINDIuNDExMlYyMy4zMTQ4SDQxLjIzNzlaTTQyLjM5MTMgMTYuNjMzQzQyLjM5MTMgMTcuMjA5NyA0Mi40NzU5IDE3LjcxODUgNDIuNjQ0OSAxOC4xNTkzQzQyLjgxMzkgMTguNTk2OCA0My4wNjA4IDE4LjkzOTggNDMuMzg1NyAxOS4xODg0QzQzLjcxMDUgMTkuNDMzNyA0NC4xMDgyIDE5LjU1NjMgNDQuNTc4OCAxOS41NTYzQzQ1LjA2OTQgMTkuNTU2MyA0NS40Nzg3IDE5LjQyNyA0NS44MDY4IDE5LjE2ODVDNDYuMTM4MyAxOC45MDY3IDQ2LjM4NjggMTguNTU1MyA0Ni41NTI2IDE4LjExNDVDNDYuNzIxNiAxNy42NzA0IDQ2LjgwNjEgMTcuMTc2NiA0Ni44MDYxIDE2LjYzM0M0Ni44MDYxIDE2LjA5NjEgNDYuNzIzMiAxNS42MTIyIDQ2LjU1NzUgMTUuMTgxM0M0Ni4zOTUxIDE0Ljc0NzEgNDYuMTQ4MiAxNC40MDQxIDQ1LjgxNjggMTQuMTUyMkM0NS40ODg2IDEzLjg5NyA0NS4wNzYgMTMuNzY5NCA0NC41Nzg4IDEzLjc2OTRDNDQuMTAxNiAxMy43Njk0IDQzLjcwMDUgMTMuODkwMyA0My4zNzU3IDE0LjEzMjNDNDMuMDUwOSAxNC4zNzA5IDQyLjgwNTYgMTQuNzA1NyA0Mi42Mzk5IDE1LjEzNjVDNDIuNDc0MiAxNS41NjQxIDQyLjM5MTMgMTYuMDYyOSA0Mi4zOTEzIDE2LjYzM1pNNTIuOTcwOSAyMC42MTAzQzUyLjIzNTEgMjAuNjEwMyA1MS42MDA0IDIwLjQ0NzkgNTEuMDY2OCAyMC4xMjNDNTAuNTM2NSAxOS43OTQ5IDUwLjEyNzEgMTkuMzM3NSA0OS44Mzg4IDE4Ljc1MDlDNDkuNTUzNyAxOC4xNjA5IDQ5LjQxMTIgMTcuNDc0OCA0OS40MTEyIDE2LjY5MjZDNDkuNDExMiAxNS45MTA1IDQ5LjU1MzcgMTUuMjIxMSA0OS44Mzg4IDE0LjYyNDVDNTAuMTI3MSAxNC4wMjQ2IDUwLjUyODIgMTMuNTU3MiA1MS4wNDE5IDEzLjIyMjVDNTEuNTU4OSAxMi44ODQ0IDUyLjE2MjIgMTIuNzE1NCA1Mi44NTE2IDEyLjcxNTRDNTMuMjQ5MyAxMi43MTU0IDUzLjY0MiAxMi43ODE3IDU0LjAyOTggMTIuOTE0MkM1NC40MTc2IDEzLjA0NjggNTQuNzcwNiAxMy4yNjIzIDU1LjA4ODggMTMuNTYwNUM1NS40MDcgMTMuODU1NSA1NS42NjA1IDE0LjI0NjYgNTUuODQ5NCAxNC43MzM4QzU2LjAzODQgMTUuMjIxMSA1Ni4xMzI4IDE1LjgyMSA1Ni4xMzI4IDE2LjUzMzZWMTcuMDMwN0g1MC4yNDY0VjE2LjAxNjVINTQuOTM5NkM1NC45Mzk2IDE1LjU4NTYgNTQuODUzNSAxNS4yMDEyIDU0LjY4MTEgMTQuODYzMUM1NC41MTIxIDE0LjUyNSA1NC4yNzAxIDE0LjI1ODIgNTMuOTU1MyAxNC4wNjI3QzUzLjY0MzcgMTMuODY3MSA1My4yNzU4IDEzLjc2OTQgNTIuODUxNiAxMy43Njk0QzUyLjM4NDIgMTMuNzY5NCA1MS45Nzk5IDEzLjg4NTQgNTEuNjM4NSAxNC4xMTc0QzUxLjMwMDQgMTQuMzQ2MSA1MS4wNDAyIDE0LjY0NDQgNTAuODU4IDE1LjAxMjNDNTAuNjc1NyAxNS4zODAxIDUwLjU4NDUgMTUuNzc0NiA1MC41ODQ1IDE2LjE5NTVWMTYuODcxNkM1MC41ODQ1IDE3LjQ0ODMgNTAuNjgzOSAxNy45MzcyIDUwLjg4MjggMTguMzM4MkM1MS4wODUgMTguNzM2IDUxLjM2NTEgMTkuMDM5MiA1MS43MjMgMTkuMjQ4QzUyLjA4MSAxOS40NTM1IDUyLjQ5NjkgMTkuNTU2MyA1Mi45NzA5IDE5LjU1NjNDNTMuMjc5MSAxOS41NTYzIDUzLjU1NzUgMTkuNTEzMiA1My44MDYxIDE5LjQyN0M1NC4wNTggMTkuMzM3NSA1NC4yNzUxIDE5LjIwNSA1NC40NTc0IDE5LjAyOTNDNTQuNjM5NyAxOC44NTAzIDU0Ljc4MDUgMTguNjI4MyA1NC44OCAxOC4zNjMxTDU2LjAxMzUgMTguNjgxM0M1NS44OTQyIDE5LjA2NTggNTUuNjkzNyAxOS40MDM4IDU1LjQxMTkgMTkuNjk1NUM1NS4xMzAyIDE5Ljk4MzggNTQuNzgyMiAyMC4yMDkyIDU0LjM2NzkgMjAuMzcxNkM1My45NTM2IDIwLjUzMDcgNTMuNDg3OSAyMC42MTAzIDUyLjk3MDkgMjAuNjEwM1pNNTkuMDkwOSAxNS44NTc0VjIwLjQ1MTJINTcuOTE3NlYxMi44MTQ4SDU5LjA1MTFWMTQuMDA4SDU5LjE1MDZDNTkuMzI5NSAxMy42MjAyIDU5LjYwMTMgMTMuMzA4NyA1OS45NjU5IDEzLjA3MzNDNjAuMzMwNSAxMi44MzQ3IDYwLjgwMTEgMTIuNzE1NCA2MS4zNzc4IDEyLjcxNTRDNjEuODk0OSAxMi43MTU0IDYyLjM0NzMgMTIuODIxNCA2Mi43MzUxIDEzLjAzMzZDNjMuMTIyOSAxMy4yNDI0IDYzLjQyNDUgMTMuNTYwNSA2My42Mzk5IDEzLjk4ODFDNjMuODU1NCAxNC40MTIzIDYzLjk2MzEgMTQuOTQ5MyA2My45NjMxIDE1LjU5ODlWMjAuNDUxMkg2Mi43ODk4VjE1LjY3ODRDNjIuNzg5OCAxNS4wNzg1IDYyLjYzNCAxNC42MTEyIDYyLjMyMjQgMTQuMjc2NUM2Mi4wMTA5IDEzLjkzODQgNjEuNTgzMyAxMy43Njk0IDYxLjAzOTggMTMuNzY5NEM2MC42NjUyIDEzLjc2OTQgNjAuMzMwNSAxMy44NTA2IDYwLjAzNTUgMTQuMDEzQzU5Ljc0MzggMTQuMTc1NCA1OS41MTM1IDE0LjQxMjMgNTkuMzQ0NSAxNC43MjM5QzU5LjE3NTQgMTUuMDM1NSA1OS4wOTA5IDE1LjQxMzMgNTkuMDkwOSAxNS44NTc0WiIgZmlsbD0id2hpdGUiLz4KPHBhdGggZD0iTTIzLjIxOCAxNC43MDQ3SDE2LjEwODFWMTEuODU3N0MxNi4xODEyIDEwLjk2ODMgMTYuNjk4NCAxMC4xNzU4IDE3LjQ4MzEgOS43NTA4M0MxOC4yNjggOS4zMjU4NyAxOS4yMTQzIDkuMzI1ODcgMTkuOTk5IDkuNzUwODNDMjAuNzgzOCAxMC4xNzU4IDIxLjMwMTEgMTAuOTY4MyAyMS4zNzQgMTEuODU3N0gyMi40Mzc5QzIyLjM1MDYgMTAuNTk3OCAyMS42Mjc2IDkuNDY4OTggMjAuNTE5NCA4Ljg2MjgyQzE5LjQxMTQgOC4yNTY2NiAxOC4wNzA5IDguMjU2NjYgMTYuOTYyOSA4Ljg2MjgyQzE1Ljg1NDggOS40Njg5OCAxNS4xMzE3IDEwLjU5NzggMTUuMDQ0NCAxMS44NTc3VjE0LjcwNDdIMTQuMjgxOUMxNC4xNDA5IDE0LjcwNDcgMTQuMDA1NiAxNC43NjA3IDEzLjkwNTggMTQuODYwNEMxMy44MDYyIDE0Ljk2MDIgMTMuNzUgMTUuMDk1NSAxMy43NSAxNS4yMzY1VjIxLjk2MDlDMTMuNzUgMjIuMTAxOSAxMy44MDYxIDIyLjIzNzIgMTMuOTA1OCAyMi4zMzdDMTQuMDA1NiAyMi40MzY3IDE0LjE0MDkgMjIuNDkyNyAxNC4yODE5IDIyLjQ5MjdIMjMuMjE4MUMyMy4zNTkxIDIyLjQ5MjcgMjMuNDk0NCAyMi40MzY3IDIzLjU5NDIgMjIuMzM3QzIzLjY5MzggMjIuMjM3MiAyMy43NSAyMi4xMDE5IDIzLjc1IDIxLjk2MDlWMTUuMjM2NUMyMy43NSAxNS4wOTU1IDIzLjY5MzkgMTQuOTYwMiAyMy41OTQyIDE0Ljg2MDRDMjMuNDk0NCAxNC43NjA3IDIzLjM1OTEgMTQuNzA0NyAyMy4yMTgxIDE0LjcwNDdIMjMuMjE4WiIgZmlsbD0id2hpdGUiLz4KPC9zdmc+Cg==" alt="open"/></li><li>Created 3 years ago</li><li><span class="IssueSummary-module--boldTitle--7ed35">Reactions:</span><span>2</span></li><li><span class="IssueSummary-module--boldTitle--7ed35">Comments:</span><span>5 (3 by maintainers)</span></li></ul></div></div></div></section><section class="sectionWrapper TopResultsSection-module--topResultsSection--ece62"><div class="Container-module--container--052f0"><div class="TopResultsSection-module--wrapper--4186d"><section class="TopGitHubComments-module--commentsSection--674bb"><h4 class="H4-module--title--7a773 "><img src="/answers/static/github_icon-09b634433ea463575cb8c3c7818ee4e2.svg" alt="github_icon"/>Top GitHub Comments</h4><div class="TopGitHubComments-module--commentsContainer--87a5a"><div class="TopGitHubComments-module--commentsWrapper--89d00"><div class="TopGitHubComments-module--itemWrapper--c6dba"><div class="TopGitHubComments-module--itemHead--c0a84"><div class="TopGitHubComments-module--itemReactions--3aa39"><span class="TopGitHubComments-module--count--e5170">2</span><span class="TopGitHubComments-module--description--034b2">reactions</span></div><a href="https://github.com/RaRe-Technologies/smart_open/issues/422#issuecomment-686704331" class="TopGitHubComments-module--name--a03f6">hoverinc-frankmata</a><span class="TopGitHubComments-module--itemTitle--6bdb1">commented, Sep 3, 2020</span></div><div class="LeftScrollContainer-module--wrapper--9987b TopGitHubComments-module--scrollContainer--9d8cc"><div class="LeftScrollContainer-module--content--0b83d"><div><p>I can confirm this problem, though I noticed it in a different manner. I tested with a file similar to above, but used “transport_params=dict(buffer_size=1024)” to force it to stream in parts. I have 4 cases to share with you. Testing with gcs files named file.txt and file.txt.gz, and ignore_ext=True and False. Data was uploaded to gcs</p> <p>file.txt with ignore_ext=True, file.txt with ignore_ext=False, file.txt.gz with ignore_ext=True Reads first buffered chunk ok, subsqeuent chunks throw “urllib3.exceptions.DecodeError: (‘Received response with content-encoding: gzip, but failed to decode it.’, error(‘Error -3 while decompressing data: incorrect header check’))”</p> <p>file.txt.gz with ignore_ext=False raises “OSError: Not a gzipped file (b’FI’)” immediately</p> <p>I modified the smart open code to add the “raw_download=True” to the download_as_string() call, and here are the results.</p> <p>file.txt with ignore_ext=True, file.txt with ignore_ext=False, file.txt.gz with ignore_ext=True File streams from open() object as a gzipped binary. Size of the data matches the compressed size on gcs. Able to decompress this data successfully using gzip.decompress(data), and the data matched exactly.</p> <p>file.txt.gz with ignore_ext=False File streams from open() object as uncompressed data. File size matches the RAW size before upload. Data matches the raw uncompressed data exacly.</p> <p>Hope this helps y’all to find a good solution. Included below is the quick and dirty script I used to demo this.</p> <pre><code class="language-#">set -e GCP_BUCKET=??? echo "START" &gt; rand.txt cat /dev/urandom | gtr -dc A-Za-z0-9 | head -c 40000 &gt;&gt; rand.txt echo "END" &gt;&gt; rand.txt ls -al rand.txt gsutil cp -Z rand.txt ${GCP_BUCKET}/rand.txt gsutil cp -Z rand.txt ${GCP_BUCKET}/rand.txt.gz gsutil ls -l ${GCP_BUCKET}/rand.txt ${GCP_BUCKET}/rand.txt.gz for f in ${GCP_BUCKET}/rand.txt ${GCP_BUCKET}/rand.txt.gz ; do for ignore_ext in True False; do python -c " from smart_open import open import gzip print('\n\n--------${f} ignore_ext=${ignore_ext}----------') with open('${f}', 'rb', ignore_ext=${ignore_ext}, transport_params=dict(buffer_size=1024)) as f: data = f.read() print(len(data)) print(data[:5]) print(data[-4:]) raw = gzip.decompress(data) print(len(raw)) print(raw[:5]) print(raw[-4:]) print('Done')