node.js - S3 fails to unzip uploaded file -


i'm following this example

// load stream var fs = require('fs'), zlib = require('zlib'); var body = fs.createreadstream('bigfile').pipe(zlib.creategzip());  // upload stream var s3obj = new aws.s3({params: {bucket: 'mybucket', key: 'mykey'}}); s3obj.upload({body: body}, function(err, data) {   if (err) console.log("an error occurred", err);   console.log("uploaded file at", data.location); })

and "works" in expected, except file arrives on s3 compressed , stays way.

as far can tell there's no auto facility unzip on s3, so, if intention upload publicly available image or video (or else end user meant consume) solution appears leave uploaded file unzipped so...

// load stream var fs = require('fs'), zlib = require('zlib'); var body = fs.createreadstream('bigfile');//.pipe(zlib.creategzip()); <-- removing zipping part  // upload stream var s3obj = new aws.s3({params: {bucket: 'mybucket', key: 'mykey'}}); s3obj.upload({body: body}, function(err, data) {   if (err) console.log("an error occurred", err);   console.log("uploaded file at", data.location); })

i'm curious if i'm doing wrong , if there automatic way have s3 recognize file arriving zipped , unzip it?

the way works s3 has way of knowing file gziped without bit of help. need set metadata on file when uploading telling s3 it's gzipped. right thing set.

you need set content-encoding: gzip , content-type: <<your file type>> in object metadata when uploading.

later edit: found these explains how cloudfront, same: http://docs.aws.amazon.com/amazoncloudfront/latest/developerguide/servingcompressedfiles.html#compresseds3
http://www.cameronstokes.com/2011/07/20/compressed-content-amazon-s3-and-cloudfront/

however note per this blogpost s3 serve file gzipped , rely on browser unzip it. works fine in many cases blogger notes fail in curl (since curl have no idea gzipped file). if intention upload file raw consumption user best bet skip gzipping , upload file in uncompressed state.


Comments

Post a Comment

Popular posts from this blog

1111. appearing after print sequence - php -

morning, i have code takes string of shoe sizes, explodes , puts in table. code works , info displayed correctly on page after table there few 1's after table. i'm confused this. so table looks (in columns of 3 on webpage) available in following sizes: 3 4 5 6 9 10 111 here's codes, purpose of example $x = 3|4|6|10|9 function get_sizes_pipe($x) { $counter = 0; $splits = explode("|",$x); asort($splits); $x = print "<table class='greentable'>"; $x .= print "<thead><tr><th scope='col' colspan='3' abbr='starter'>available in following sizes:</th></tr></thead><tbody><tr>"; foreach ($splits $split) { $entry = print "<td>".$split."</td>"; if($counter == 2){ $entry .= print "</tr><tr>"; $counter =0; } else { $counter++; ...
Read more

java - WARN : org.springframework.web.servlet.PageNotFound - No mapping found for HTTP request with URI [/board/] in DispatcherServlet with name 'appServlet' -

this question has answer here: why spring mvc respond 404 , report “no mapping found http request uri […] in dispatcherservlet”? 3 answers i trying making simple bbs i'm encountering following error, warn : org.springframework.web.servlet.pagenotfound - no mapping found http request uri [/board/] in dispatcherservlet name 'appservlet' i have tried solve error many times, have failed. how can solve error? here web.xml, controllerand , servlet-context. my web.xml <?xml version="1.0" encoding="utf-8"?> <web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://java.sun.com/xml/ns/javaee http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd"> <filter> <filter-nam...
Read more

Ruby on Rails, ActiveRecord, Postgres, UTF-8 and ASCII-8BIT encodings -

weirdest error, who’s challenge try , me? spent hours yesterday on , it’s magic. can't believe happening , it's driving me crazy. btw, using: rails 4.2.3 ruby 2.2.3 pg 0.18 encoding.default_internal = encoding.default_external = utf-8 config.encoding = 'utf-8' it has postgres, activerecord , encodings! turns out we’ve been getting these errors whenever create new users on database special characters: encoding::undefinedconversionerror: "\xc3" ascii-8bit utf-8 \xc3 may vary depending on characters. weird part we’ve set since beginning utf-8. makes no sense , digged it, , used script: user.all.each |user| user.attributes.each |name, value| if value.is_a? string puts user.email + name.encoding.to_s + value.encoding.to_s end end end and output of 1 of users, users same: dr_lottahelp@blahblah.comutf-8utf-8 dr_lottahelp@blahblah.comutf-8ascii-8bit dr_lottahelp@blahblah.comutf-8ascii-8bit dr_lottahelp@blahblah.comutf-8asci...
Read more