Zencoder/Amazon S3 not processing .mp4 videos

vincebodie · Jul 24, 2018

I believe I have set up Amazon S3 and Zencoder correctly, because 12 days ago I was able to successfully upload one .m4v video named "small..." and everything worked fine as you can see here:

https://quinnguitar.com/student-lounge/videos

However, I have since tried uploading two .mp4 videos and they apparently do not get processed by Zencoder. When I login to my Zencoder account they do not even show up:

However, if I look in the front end of the site under "Pending videos", there they are:

There are no thumbnails created, but if I click on one of the pending videos, they do actually play:

And if I look in the back end, all three videos show up:

What am I doing wrong?

Also, I have changed several settings in my php.ini file, but the changes are not reflected in the JS back end. For example, I set 'upload_max_filesize' to 1024MB in php.ini, but in the JS back end under 'Video Settings' it still shows only 128MB:

I made these changes in two places:

at the root level of my VPS server via WHM:

In the php.ini file in the user account for quinnguitar.com:

Is there another place to change these settings that I am missing?

Thanks in advance for your help!

Vince

Ninja · Jul 25, 2018

vincebodie
Hi
Kindly try to set cronjob interval to 5 minutes or more. And make sure the video exist at S3 storage for the zencoder.
zencoder needs the files on Amazon s3 so it can pick by zencoder to convert it.
If the files exist on S3 there could be some issue from the server configurations.

As you can see the error for zencoder failed showing in the screenshot. kindly check the file exist or not.
If still same issue we need login access for Amazon s3 and zencoder login detail to check the configurations.

Regards

vincebodie · Jul 25, 2018

Ninja

Thank you for the reply. I currently have this cron job set to run every 10 minutes:

lynx -useragent=cpanel-cron -source "http://quinnguitar.com/index.php?option=com_community&task=cron" > /dev/null

I just noticed that the URL for the bucket was incorrect. It seems that it got reset to the default after updating JS to 4.5.6:

<bucket>.s3.amazonaws.com

I reset it to 'quinnguitar.s3.amazonaws.com' and uploaded another video from the front end and I am waiting to see if it gets processed.

Any idea why I am seeing this in the back end of JS despite the fact that I have changed php.ini to 1024M?:

upload_max_filesize defined in php.ini 128 MB

vincebodie · Jul 25, 2018

By the way, what is the correct format for the bucket URL? The documentation and associated YouTube video are so old that it shows the Joomla 2.5 back end (!), and there was no URL parameter at that time:

The current version:

Do I have the URL set correctly, or should it be like this?:

s3-us-west-2.amazonaws.com/quinnguitar

vincebodie · Jul 25, 2018

Ninja

I am not seeing the files being uploaded to S3. I have sent you the logins for AWS and zencoder via email.

Thanks,
Vince

Ninja · Jul 26, 2018

vincebodie
Hi
I have not got any email for the login, can you check and add the details on edit fields option in the first post : https://cl.ly/3y3R0p24250G
Also, did you check the Amzone S3 for the video file is present on it.
The URL you need to add is : <bucket>.s3.amazonaws.com
<bucket> is the name of the bucket.

Regards

vincebodie · Jul 26, 2018

Ninja
Hi, please tell me what email address to use and I will resend them. It now appears that the cron job is not functioning properly, because when I trigger the cron job manually by entering the URL in a browser everything works as it should.

Thanks,
Vince

Ninja · Jul 26, 2018

vincebodie
Hi
I tested the video uploads and its working on your site : http://prntscr.com/kb5ltr
For the cronjob please make sure you have added the Cron As mentioned Here
You can add the login information on edit details first post as well.
Here is my email : pankaj @ joomlart.com

vincebodie · Jul 26, 2018

Ninja
Thank you.

Did you run the cron manually for your test? If not then everything is working and there is no need to send you the login info.

By the way, the email address you gave me is the one I used previously. You may want to check your spam folder.

Thanks again,
Vince

Ninja · Jul 27, 2018

vincebodie
Hi
Seems the email not received, for cron please make sure you have added it correctly on server, Also, ask the hosting provider that the cron is running on the interval you set.

Regards

vincebodie · Jul 27, 2018

Ninja
Hi,

I just resent the email.

Here is the cron syntax:

lynx -useragent=Lynx -source "https://quinnguitar.com/index.php?option=com_community&task=cron" > /dev/null

If I turn on email notifications for the cron in my web hosting panel, I get this via email:

Please let me know if you received my email.

Thanks,
Vince

Ninja · Jul 28, 2018

vincebodie
Hi
Kindly use this command :

wget -O /dev/null "https://www.yoursite.com/index.php?option=com_community&task=cron" > /dev/null

Hope it helps.

Regards

vincebodie · Jul 28, 2018

Ninja
That seems better:

I just uploaded the video "Reggae Rhythm Primer" that was a 70MB .mp4 file, and it worked great:

So that is progress!
Now the issue I am having is with larger files. I just tried uploading a 156MB .mp4 file, and it gets stuck after the green progress bar is done. The little indicator below "Say something about this video" just keeps going and never stops:

The file was not uploaded to S3:

Nor is it showing in zencoder:

What now?
Thanks

Ninja · Jul 30, 2018

vincebodie
Hi
Kindly increase set max_execution_time to 3000 , large file use more server resources for upload and it may be timeout before the file upload.
Let me know if it helps.

Regards

vincebodie · Jul 30, 2018

Ninja
Hi,
I did that and I am still getting this:

Here are some of the relevant php settings from the Joomla "System Information" tab if it helps:

Ninja · Jul 31, 2018

vincebodie
Hi
It does not seem server moving the File to S3, I shared it to the development team to debug further, we will give you an update soon on it.

Regards

Ninja · Aug 2, 2018

vincebodie
Hi
I tried multiple file uploads with different size ad the issue comes for large file only after 130MB + the server does not allow to upload the large files and gives 413 error. http://prntscr.com/kdnecv
Please ask the server provider to increase the limits, you can share the error as well.
[here](
https://www.cyberciti.biz/faq/linux-unix-bsd-nginx-413-request-entity-too-large/) is solution that may helped you on this change.

Regards

vincebodie · Aug 2, 2018

Ninja
Hi,
Thank you, I have contacted my hosts about increasing 'LimitRequestFieldSize' which seems to be the answer. I will get back to you with the results.
Thanks,
Vince

vincebodie · Aug 13, 2018

Ninja
Hello again,

I was able to begin the process of increasing 'LimitRequestFieldSize' myself and then with InMotion's help they finished the process:

In order to complete the process to modify Apache values, you have to run the Apache configuration check, and then restart Apache. This is done as follows:

/scripts/rebuildhttpdconf

Then restarting the service. I've done this for you at this time, can you please test this? If there's no joy on the situation and you're still seeing issues with large file uploads, please provide us a way to replicate the issue if possible, or a URL to where we can view the upload form and do some testing. We'll be a bit limited since we don't have large files to upload for testing offhand, so if you can provide a dummy file for us to test with, that would be useful as well.

However, this did not fix the issue, so I wrote back to them and got this response:

I created a php.ini file which will allow the large upload size of the file you submitted. This said, the web-site is not able to process the upload as far as I can tell. I timed it attempting to upload ( using the pool system call ) from 21:56 until 22:09 on the servers time ( Sun Aug 12 22:10:24 EDT 2018 ).

As the maximum upload size is reflected; however, the operation never completes, you will need to reach out to your developer and/or the Joomla community. If you do not have a developer you may be able to find one on a site such as fiverr.com.

=== proof of work ( /home/quinnguitar/public_html/php.ini ) ===
; Support 2018-08-12T21:45:56-0400
session.save_path = /home/quinnguitar/tmp
upload_tmp_dir = /home/quinnguitar/tmp
display_errors = On
log_errors = On
error_log = error_log
max_execution_time = 3000
max_input_time = 3000
memory_limit = 2048m
upload_max_filesize = 1024M

post_max_size = 2048M

Any more ideas for me?
Thanks
Vince

vincebodie · Aug 13, 2018

More info from InMotion:

Thank you for reaching back out to us. I'm sorry to hear about you continuing upload error. I have attempted to replicate this and I do see the issue you are referring to. The issue with us troubleshooting this is that there are no errors that are being thrown that we can look into to see what may need to be adjusted server side, if that is the case, to assist with this. In addition, as this file can be uploaded via File Manager, PHP can support the upload of files of this size. With these being the case, we will need you to reach out to a Joomla developer to look into the issue further and for possible errors and suggestions of anything that may need tweaked server-side in order for this to work. Please let us know if you have any further questions; we are more than happy to help.