Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
M
mybee
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
vicotor
mybee
Commits
36018f53
Unverified
Commit
36018f53
authored
Jun 19, 2020
by
Janoš Guljaš
Committed by
GitHub
Jun 19, 2020
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
use singleflight in retrieval (#338)
parent
303ac3af
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
21 additions
and
13 deletions
+21
-13
retrieval.go
pkg/retrieval/retrieval.go
+21
-13
No files found.
pkg/retrieval/retrieval.go
View file @
36018f53
...
...
@@ -16,6 +16,7 @@ import (
"github.com/ethersphere/bee/pkg/storage"
"github.com/ethersphere/bee/pkg/swarm"
"github.com/ethersphere/bee/pkg/topology"
"golang.org/x/sync/singleflight"
)
const
(
...
...
@@ -34,6 +35,7 @@ type Service struct {
streamer
p2p
.
Streamer
peerSuggester
topology
.
EachPeerer
storer
storage
.
Storer
singleflight
singleflight
.
Group
logger
logging
.
Logger
}
...
...
@@ -72,22 +74,28 @@ const (
)
func
(
s
*
Service
)
RetrieveChunk
(
ctx
context
.
Context
,
addr
swarm
.
Address
)
(
data
[]
byte
,
err
error
)
{
var
skipPeers
[]
swarm
.
Address
for
i
:=
0
;
i
<
maxPeers
;
i
++
{
var
peer
swarm
.
Address
data
,
peer
,
err
=
s
.
retrieveChunk
(
ctx
,
addr
,
skipPeers
)
if
err
!=
nil
{
if
peer
.
IsZero
()
{
return
nil
,
err
v
,
err
,
_
:=
s
.
singleflight
.
Do
(
addr
.
String
(),
func
()
(
v
interface
{},
err
error
)
{
var
skipPeers
[]
swarm
.
Address
for
i
:=
0
;
i
<
maxPeers
;
i
++
{
var
peer
swarm
.
Address
data
,
peer
,
err
=
s
.
retrieveChunk
(
ctx
,
addr
,
skipPeers
)
if
err
!=
nil
{
if
peer
.
IsZero
()
{
return
nil
,
err
}
s
.
logger
.
Debugf
(
"retrieval: failed to get chunk %s from peer %s: %v"
,
addr
,
peer
,
err
)
skipPeers
=
append
(
skipPeers
,
peer
)
continue
}
s
.
logger
.
Debugf
(
"retrieval: failed to get chunk %s from peer %s: %v"
,
addr
,
peer
,
err
)
skipPeers
=
append
(
skipPeers
,
peer
)
continue
s
.
logger
.
Tracef
(
"retrieval: got chunk %s from peer %s"
,
addr
,
peer
)
return
data
,
nil
}
s
.
logger
.
Tracef
(
"retrieval: got chunk %s from peer %s"
,
addr
,
peer
)
return
data
,
nil
return
nil
,
err
})
if
err
!=
nil
{
return
nil
,
err
}
return
nil
,
err
return
v
.
([]
byte
),
nil
}
func
(
s
*
Service
)
retrieveChunk
(
ctx
context
.
Context
,
addr
swarm
.
Address
,
skipPeers
[]
swarm
.
Address
)
(
data
[]
byte
,
peer
swarm
.
Address
,
err
error
)
{
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment