OK, I finally figure it out how to make it work. Share on here so anyone who have the same question like me will be able to get it work.
1. Create a new folder under "plugin" and name it as "filebrowser"2. Copy the js script from http://docs.cksource.com/ckeditor_api/symbols/src/plugins_filebrowser_plugin.js.html3. Save the js script into "filebrowser" and name it as plugin.js4. On your Textarea html code add your code. Below is my own code as sample
CKEDITOR.replace( 'fmsg',{filebrowserBrowseUrl : '/browser/browse.php',filebrowserUploadUrl : '/uploader/upload.php'});CKEDITOR.replace( 'fmsg', { toolbar : 'MyToolbar' } );