Blogs

Gitprime vs. Haystack vs. Waydev

Julian Colina
July 24, 2020

Building data-driven teams is more important than ever in this dynamic and growing software development industry.  Implementing the right analytical tools, and metrics into your team culture will have tangible impacts on productivity and code quality from the jump.  We've put together a comprehensive list of the leading Software Development Analytical Tools and what sets them apart.  


Integrations:

Haystack: Plugs directly into your repositories using the Github API. We analyze the past 6 months of historical data to determine 'healthy area' for each team, repository, and member. Our system compares incoming activity to success heuristics we've collected over the years so when things look out of the ordinary or worth noting - we'll tell you about. Simple as that.

1. Create a Haystack Account

2. Install our Github App

3. Choose which repositories to plug into Haystack

4. Sit back and relax while insights roll into your inbox

Haystack is built to support all version control platforms but at the moment we have a waitlist for Gitlab and Bitbucket users. On-premise solutions are supported with our Enterprise plan and if you need a custom integration just let us know at sales@usehaystack.io


GitPrime: GitPrime’s setup is much the same as Haystack’s setup. Select your data provider, authorize access, and check the repos for GitPrime to analyze.

A benefit of using GitPrime is the range of control systems with variable workflows. You can connect to your GitLab, GitHub, or your Bitbucket to import your repositories. From GitLab, GitHub, or Bitbucket, you can arrange your repositories according to its tag. A contributor can be integrated into teams or concealed from reports.


Waydev: Set up your Waydev account by signing into your GitHub, GitLab, Bitbucket, or Azure DevOps account and authorizing Waydev’s access. Choose the repositories you want Waydev to analyze and then click the ‘Load Project’ button.

Waydev provides integrations with GitHub, GitLab, Bitbucket, Azure DevOps, and their on-premise counterparts. The access can be granted through OAuth or Personal Access Tokens. Waydev also allows SSO integrations through Okta and offers an API.





Performance Metrics:

Haystack: Haystack provides a platform of metrics that helps engineering teams prosper. No individual data, developer - developer comparisons, or unwarranted surveillance. Just simple, team-oriented insights straight from git. We help you accurately visualize the health of your team, become more efficient, and retain quality.

CycleTime: Cycle Time can help visualize how quickly your team delivers and how that changes over time. Cycle time is the time from first commit to merging of the pull request. This gives you a high level view of how quickly your team is delivering. It allows you to visualize the effect of recent changes, track them over time, and see how well your team is improving.

Throughput: Merged Pull Requests helps understand how much work your team typically finishes during a sprint. Having a consistent amount of Merged Pull Requests shows consistency in your team’s throughput. This generally shows that your team is consistent in planning, execution and is a good indicator of healthy sprint planning and estimations.












GitPrime:

  • Impact: GitPrime measures the perceived difficulty of an edit to the codebase.  Their algorithm is based on insertion points, lines of code, and number of files change.
  • Churn: Is essentially how much code has been reworked. When any contributor refactors any chunk of code this value increases and can represent wasted effort.
  • TT100 Raw:  The time it takes any engineer to produce 100 lines of code, disregards the quality of that code.  Lines of code is easy to identify as a bad metric. Not only do different languages have different formatting conventions (3 lines of code in one language is 20 lines in another) but it's extremely difficult to compare. Any good software developer knows that good code or refactors are actually trying to produce less code, not more. So why measure and track a metric that incentivizes the opposite of the good practices and behaviors we want? It's a terrible KPI for software development
  • TT100 Productive: The time it takes for an engineer to produce 100 lines of code, after churn. This metric represents speed and quality, and GitPrime recommends that managers look at this metric together with TT100 Raw.




Waydev: Impact:  Essentially tries to gauge the weight of each developer’s load based on the amount of code changed and the number of locations of changed code, neither of which have proven very accurate or standard so this metric is pretty much disregarded as a reliant measure of developer productivity across the industry.  


Churn: Represents the percentage of code that has been reworked, rewritten or deleted shortly after being written.  This metric as well is not a dependable measure of developer productivity, difficult tasks are rarely done perfectly on the first try.  The complexity of code is not taken into consideration and neither are the specifications changes or requirements.  This is not an actionable metric.


Risk:  Measures the likelihood of a commit to cause a problem based on the commit’s size, the integration of the commit into the codebase, and the importance of the commit to the existing code.  

Review Coverage: which calculates the percentage of pull requests that had been reviewed. As an engineering leader, you want your team to continually improve its workflow. This metric helps you gain a better understanding of your team’s code review process and aids you in optimizing engineer collaboration.







Benchmarking Features:

Haystack:

Weekly Trend Report: Sprint summary reports in your inbox every week.

daily alerts: actionable and tangible daily alerts regarding high or low working patterns,

throughput baselines

CycleTime breakdown: Customize your CycleTime reports to any specific timeframe to better understand how your team's delivery process is improving over time. Not just how quickly your team is delivering, but why.

Real-time trend analysis, anomaly detection: Identifies burnout before it even happens by recognizing and alerting you to unsustainable or atypical working patterns within your team.


GitPrime:

Fundamentals: Analyzes four metrics, Impact, Efficiency, Commits per day and Active days.  GitPrime's dashboard display features your monthly averages, industry specific benchmarks, and targets customized from historic performance. ,

Review Workflow(not available in Standard price plan): Tracks and logs recent pull request activity over the past two weeks. Can see the status of each request in addition to any comments or changes.




Waydev:

Dashboard: Overview which allows you to benchmark your team's performance relative to historical performance. Flags commits, identifies top performers., Compare, Project Timeline, Sprints, Work Log, Developer Summary

                     

Compare: Compare all of your engineers performances against one another, ranks them over a certain timeframe. Can also filter this by repository.

Surfacing Issues:

H: Where Haystack sets itself apart from the competition is in the actionability of their alerts. In real-time Haystack will detect and notify you to concurrent work alerts, long or risky pull requests, lightning pull requests, and celebrations when complex work is completed. Rather than placing unwarranted surveillance on each developer, Haystack promotes communication, goal-alignment, and team health through its set of simple, actionable alerts straight to your inbox.

GitPrime: Work Log: This is GitPrime's homepage, displaying an aggregate graphic display of each developer's commits, ticket comments, Pull Requests, and Merged Pull Requests.

Spot Check: A displayed analysis of each developer's individual performance over a certain timeframe based on increases and decreases in GitPrime's central metrics. Used by some teams to suggest improvements as well as shape bonuses and reward plans. Click on any engineer’s day from the main report to enter a focused view for a given time period. The selected day will be in focus, providing a chronological view of their contributions for the 24 hour period.

Waydev: Offers a number of features that deliver insights to identify potential problems on the horizon.

Developer Summary:  Single in on any one developer and this feature will give you a complete picture of their commits over any amount of time. See where their time and focus has gone over the past week, month, day, etc. If something sticks out such as an abnormally high churn, ask the developer to have a sit-down or a one-on-one to figure out what is going on.


Pricing:

Haystack: Which plan is right for you? Start with one team and scale from there. We offer flexible pricing for any size team.

GitPrime:

Waydev:




Julian Colina
CEO & Cofounder of Haystack.

Our latest news

Discover our latest articles, feature releases, and more!

Ready to get started?

Start Free Trial