Vikrama Sanjeeva

Ranch Hand
+ Follow
since Sep 02, 2001
Cows and Likes
Cows
Total received
0
In last 30 days
0
Total given
0
Likes
Total received
1
Received in last 30 days
0
Total given
0
Given in last 30 days
0
Forums and Threads
Scavenger Hunt
(keep public parts private until JForum day)
expand Ranch Hand Scavenger Hunt
expand Greenhorn Scavenger Hunt
Moderation Tools

Recent posts by Vikrama Sanjeeva


I understand that GA performs analytics and stores analytics data in google analytics storage. I'm not sure of it's length, but as I remember, it can store for longer time may be 2+ years. I've integrated GA with one corporate portal back in 2010. It worked wonders, without a doubt.

What I'm worried is user data and app data. Which I will store in MongoDB. So if some analytics has to perform on this data, then I don't think GA will come in handy here. After your advise (of not using Hadoop unnecessarily until required), I think I've to use R Studio to write our own custom data analysis algorithms. I'm not familiar with R, but it's is one of the language in my research road-map to master upon. Please suggest, how you see things in this case? That is, performing analytics on user data and app data to make value out of the collected data which in turn will help business to make future decisions. I'm not experienced with R, but of you can suggest something simple here using R then it would be great for me and my app.

Many thanks.

Viki
1 year ago
Wonderful !!

I completely agree with the rational behind your advise.

Just few things:

  • You said, GA provides end to end pipeline for free. I tried to look into free storage but only free storage I found in 15GB google drive. May be I'm missing something here? Could you please provide some starting links to this end to end service for free which includes all 5 services you mentioned (data collection storage, transfer, processing, visualization) ??


  • Secondly, just for info, we do have Hadoop cluster setup as part of uni project, which the management encouraged me to use instead of going for paid online services (actually initially I proposed Firebase, but they (the management) is not willing to pay continuously for Firebase service in future, that's why asked me to the already made Hadoop cluster).


  • Rest, I really appreciate yours ideas of learning the echo-system side by side on non-critical prototype, gathering data with GA and setting up a business culture for taking necessary decisions based on the collected information. This is indeed very piratical advise, as well as using Hadoop when really required.

    Also thank you very much for raising the JDBC compliance issue of MongoDB !!

    Many thanks.

    Viki.



    1 year ago

    chris webster wrote:Hadoop is all about distributing your data and your processing across multiple cheap machines. The data is replicated so there are e.g. 3 copies of each block of data, with diifferent copies on different machines. If you have more nodes than replicas, e.g. 3 replicas across 6 nodes, then on average each node only contains half the total original data volume. Hadoop knows where your data is replicated, so it can decide to process different subsets of your data on different nodes at the same time. This is how Hadoop allows you to exploit the power of distributed processing.

    If you only have two nodes, and your replication factor is 2 or more, then each node contains all your data anyway, so Hadoop cannot decide how to break up the processing in this way. And if you only have one node, then nothing is distributed at all.



    The first case you mentioned i.e of 3 replicas across 6 nodes, you mentioned Hadoop can decide what to process where.

    Whereas, in your last example, i.e two nodes with replication factor is 2 or more, in this case you said, Hadoop cannot decide how to breakup processing.

    My question, why in 2nd case, Hadoop cannot decide ? If both nodes are deployed on two separate machines, and one machine is loaded and not have good resources as compare to the other, then don't you think YARN will select the second machine to process the task ?

    Thanks.

    Viki.
    1 year ago
    Hi,

    I'm here to take a expert advise on using Hadoop or not for my situation/case.

    Brief intro: I'm a masters by research student doing research in BigData area which I wish to explore more by continuing into PhD.

    We've a side project in its inception phase (not related to my research) for developing mobile app using Ionic framework. One of the non-functional requirement of the project is to collect various analytics, for example, how many times apps downloaded, visited, which feature is used more, which user uses what etc etc. As a part of proposed solution, we've proposed to use Google Analytics to capture the required analytics and MangoDB for storing user's data.

    I believe these statistics can be easily captured by GA. However, recently, I was thinking to use Hadoop and its related technologies (Hive, Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will get a chance to work on Hadoop echo-system which will be a good compliment with my Master's research which is in BigData.

    What I know that Hadoop is mainly used where we have really BigData (in TBs or more) in a variety of format (unstructured, semi-structured) and where value out of data is needed by performing analytics.

    My question is, we will not have much data in mobile app, but we do have data analytics work in app. So does it make sense (reasonable?) to export data from MangoDB into HDFS and use Hive or Impala for doing analytics ?

    Please give feedback. Your expert advise is highly appreciated.

    Many thanks.

    Viki.
    1 year ago
    Hi,

    In my case; System B is completely a separate System. Actually, we own System A which provides payment services by publishing required Web Services. Whereas other systems (B1,B2,Bn) integrates with System A in order to make payments.

    After above replies, I am concluding that System B can be shown as (Primary) Actor as it will be the one who will be initiating interaction (s) with System A.

    Bye
    Viki
    Hi,

    In my case; my system (A) is publishing a web service which another system (B) invokes to make payment. There is a series of interactions between A and B where A fullfill demands/needs of B by providing required services.

    My question here: Whether system B can be shown as ACTOR in Use Case ?

    Bye
    Viki
    For Visio check Templates by Pavel Hruby

    Recommended by Martin Folwer

    I've just imported these stencils and it looks simple and complete.

    Bye
    Viki
    Hi all,

    There is an app A, providing an interface for payment processing to all those apps (B1, B2, ...) connecting to it. Means app A takes payment details as an input from B1, B2 etc and passes this input to a payment processor.

    App A will publish its services via various modes (WS, JMS, Sockets etc) so that B1,B2 has multiple ways to connect app A.

    I want to assure:

  • 2-Way communication between A and B1,B2 etc is secure and confidential
  • Both A and B1,B2 has assurity that they are communicating to the right partner. Means, in case, if someone forge the IP of B1,B2 then A must know that its not communicating with the right person.

  • Both A and B1,B2 etc belongs to same intranet but different network segments. Probably, A will be on separate box and behind firewall.

    Kindly advise what are the methods available to assure above two points


    Bye,
    Viki
    5 years ago
    Dear karas,

    Not 100%, but I can understand the pain you are going through as it happened to me as well. But may be not to the same extent as you are having. I tried myself to cope up with the problem and for this I tried to ignore the "bads" which were causing disorder AND to focus (concentrate) on my job/task. This really worked because I was having a big and urgent responsibility in executing project. At that time I thought either I keep reminding myself with the "BADs" and "DO BADS" in my job OR forget/ignore the "PREVIOUS BADS" and "FOCUS/CONCENTRATE" on job/task. I selected 2nd option i.e. to ignore as much as possible. Of course its not a one-day job, but one has to keep practicing it until he really achieve his job/responsibility/company targets.

    You should be thankful to God that you have job in hands and that you were having hand-on skills with the responsibilities you are assigned. Take this benefit as a +ve side of your situation and try to utilize it in order to get back to life and to cope with memory loss problem. You can try ball games like table-tennis in which your whole concentration is on-the-ball for some good time. You can try to play checkers to get the feeling of "focus/concentration". In my opinion the better you have focus/concentration the more you can cope with memory loss issue.

    take care and Good Luck

    Bye,
    Viki.
    6 years ago
    Hi all,

    In total of 7 yrs of career I have worked as software engineer, sr. software engineer and team lead where I was more into technical stuff. But now I have been hired as system analyst and my most of the work is related to documentation like writing project/executive summary, scope of work, introduction, system overview etc. In this role, I am facing problem in writing skills and specifically "english skills". Its getting difficult to elaborate a technical understanding in non-technical jargon with the selection of right words/vocabulary. Sometimes, I felt short of words and repetitions occurs when it comes to define same functionality in same document

    I think, I need to enroll myself in some english language course which could help me improve my english language and documentation skills.

    So, please suggest which course is suitable for my purpose, and how can I improve/develop the required skills


    thanks

    Bye,
    Viki
    6 years ago
    I agree with Deepak & Arulk that myself is the best person. I already had a resume in place which I created after a long researching. I think it needs some refinements now ... like adding Professional Summary at the top. But what am thinking now is to get my "resume critique" from http://www.1st-writer.com/critique.htm ...

    I have been surfing with this site and it looks like its good service.

    If anybody here would like to give my thought a second review then it would be appreciative.

    Thanks.

    Bye,
    Viki
    6 years ago

    Matthew Brown wrote:Shouldn't the sort of areas of expertise you're mentioning there be in your CV anyway?



    Good question. Keeping this point in mind, am now thinking to refine my existing resume by adding a new portion on 1st page of CV; let's say "Profile" which will be a quick highlights of my experience and skills. In other words, the motive which previously I was thinking to achieve through "a generic cover letter" typically of 150 words will now be covered by a quick Profile segment added on 1st page of resume consisting of around 70-90 words in a bullet listing.

    6 years ago

    Henry Wong wrote:

    Vikrama Sanjeeva wrote:A cover letter, starting with "Dear Sir/Madam:" and expressing myself and my expertise

    I think I would just throw generic ones away -- as they don't add any useful facts to the resume.



    By generic, I mean not targeting to any specific job but expressing an area of applicable expertise where my skills and qualification can be utilized. For example, I find myself good in Business Analysis, Team Leading type jobs which is in fact my area of expertise.


    So, in my case, I would like to enclose a cover letter which enable the employer to get a quick overview of myself and help him decide where he can utilize my skills and experience.


    I am not sure how it sounds in "market point-of-view" but at-least it looks like a first hand knowledge "about me"

    Bye,
    Viki.

    6 years ago
    One more advice I need. Since I will be targeting a job market in new country (for relocation purposes), therefore, do you think that I should make a general Cover Letter which I can drop to any company while job hunting ? A cover letter, starting with "Dear Sir/Madam:" and expressing myself and my expertise


    6 years ago